US Executive Order 14409 - Promoting Advanced Artificial Intelligence Innovation and Security 3a: Treasury, NSA and CISA with NIST: classified benchmarking of AI models' cyber capabilities and the covered frontier model threshold

What does 3a require?

Within 60 days, the Treasury Secretary, the NSA Director (for the Secretary of War) and the CISA Director (for the Homeland Security Secretary) build and keep up a classified benchmarking process that measures how capable AI models are at advanced cyber operations and fixes the capability threshold above which a model is designated a covered frontier model. They consult the APST (the President's science and technology assistant), the NIST Director for Commerce, and the White House Chief of Staff via the National Cyber Director, and coordinate with other agencies as needed; assessments are shared with developers and researchers where appropriate. The NSA Director makes each designation after consulting the APST, the CISA Director, the National Cyber Director and other Department of War representatives.