ISO/IEC 24029-2:2023
Clause 6: Choosing formal methods that fit the network and its data – ISO/IEC 24029-2:2023

ISO/IEC 24029-2:2023 6.2.1: Classify and choose verifiers by completeness, determinism, model access and arithmetic

What does 6.2.1 require?

Candidate formal methods are classified on four axes before one is chosen. Complete verifiers give an exact answer, a proof or a concrete counterexample, but struggle with high-accuracy networks on hard datasets; incomplete verifiers use abstraction to scale but can fail to prove a property that holds. Deterministic verifiers prove a property for every input in the region, whereas networks that output a distribution need parameters of that distribution bounded or probabilistic guarantees. Glass-box verifiers need the architecture and learned parameters, not the training data; where the model is inaccessible, closed-box verifiers that only run the model are used, at some loss of precision. Most verifiers assume ideal real arithmetic, so their guarantees do not transfer to floating-point execution unless a verifier sound with respect to the computer arithmetic is used.

Maintained by Gerard Blokdyk

Other controls in Clause 6: Choosing formal methods that fit the network and its data – ISO/IEC 24029-2:2023

Query this from an agent

The graph holds this control, the 0 it maps to, and the evidence behind each claim, over MCP and REST.