Ireland Guidelines for the Responsible Use of AI in the Public Service (2025) 4.2c: Test and monitor across the lifecycle for accuracy, reliability and reproducibility, and escalate shortfalls

What does 4.2c require?

Procedures for testing and monitoring run through the whole lifecycle. Verification and validation testing confirms the procedures were followed, tests model accuracy comprehensively and simulates every condition the system will meet. Reproducibility is assessed where required, and where GenAI cannot deliver it the body reconsiders whether GenAI suits the task. Where full accuracy is not possible the body knows the likelihood of errors and documents why deployment still proceeds and how risk was mitigated. In deployment and operation, real-world performance is compared with test results and shortfalls are escalated to the development team.