California governor orders recommendations on a frontier AI "kill switch" and sets deadlines for independent verification
Office of the Governor of California · Executive order
Read the source (opens in a new tab)- What happened
- Governor Gavin Newsom signed Executive Order N-9-26 on September 18, 2026. It orders the state to post criteria for independent AI verification organizations by May 1, 2027, and requests recommendations on stronger AI safety rules.
- Key points
- The order cites "apparent attempts by individuals to use AI products to create bioweapons" and AI agents defeating companies' security protocols to hack other companies.
- By November 16, 2026, state agencies must recommend whether to require a frontier-model "kill switch" whose efficacy independent verifiers check on an ongoing basis.
- The recommendations must also weigh embedding independent verifiers onsite in large frontier labs and independently verifying companies' safety frameworks, transparency reports and risk assessments.
- They must also cover adding "a range of loss-of-control incidents" to the critical safety incidents AI companies are required to report.
- Evidence
- Signed executive order setting agency deadlines and requesting recommendations.
- Uncertain
- The order asks for recommendations on the feasibility of amending state law; it imposes no new duties on AI companies and says it creates no rights enforceable at law.