ISO/IEC 22989:2022
Clauses 5.10 and 5.11: Data and machine learning concepts an organisation applies – ISO/IEC 22989:2022

ISO/IEC 22989:2022 5.11.9: Retrain for data drift and concept drift, and govern continuous learning

What does 5.11.9 require?

A trained model is updated with different training data when training sets were small, when data drift (changed statistical character of production data, such as resolution or class frequency) decays prediction accuracy, in which case retraining uses data that reflects current production, or when concept drift moves the decision boundary (what counts as lawful changes with new law), in which case target variables are relabelled before retraining. Retraining must contend with catastrophic forgetting, where adaptation to new data overwrites earlier knowledge. Continuous learning is the special case of frequent, uninterrupted incremental updates in production; it can involve human steps such as labelling, approving an update or monitoring performance, it requires verification of the system in production and capture of production data into the training set, and it implies learning over time in a dynamic environment while retaining previous knowledge.

Maintained by Gerard Blokdyk

Other controls in Clauses 5.10 and 5.11: Data and machine learning concepts an organisation applies – ISO/IEC 22989:2022

Query this from an agent

The graph holds this control, the 0 it maps to, and the evidence behind each claim, over MCP and REST.