ISO/IEC 24029-2:2023
Clause 5: Robustness properties and criteria (domain, stability, sensitivity, relevance, reachability) – ISO/IEC 24029-2:2023

ISO/IEC 24029-2:2023 5.5.1: Use a relevance property where a human could do the task

What does 5.5.1 require?

A relevance property orders the inputs by their impact on each output and checks that ordering against the order the AI developer requires, so that performance is shown to rest on the right reasons rather than merely asserted. Because experts can disagree on what ordering is acceptable, the comparison protocol should include a method for resolving conflicting results, for example a vote. The property should be used where the network performs a task a human could perform, so that the justification of each output can be understood and verified, manually by an operator or automatically against references checked beforehand.

Maintained by Gerard Blokdyk

Other controls in Clause 5: Robustness properties and criteria (domain, stability, sensitivity, relevance, reachability) – ISO/IEC 24029-2:2023

Query this from an agent

The graph holds this control, the 0 it maps to, and the evidence behind each claim, over MCP and REST.