Skip to main content

News · Security & Policy

Newsom Issues Executive Order Mandating AI 'Kill Switch' for Frontier Models

California's governor signed an executive order requiring frontier AI companies to develop an emergency shutdown mechanism whose effectiveness must be regularly verified.

2 min read Source: theverge.com

What changed: California moved to establish mandatory emergency shutdown mechanisms and onsite independent auditing requirements for frontier AI models, stepping into the regulatory gap left by federal inaction.

California Governor Gavin Newsom signed an executive order aimed at accelerating AI safety oversight. The order positions the state to mandate that companies building frontier AI models create a 'kill switch' — an emergency shutdown mechanism whose effectiveness must be routinely verified. The order was confirmed independently by the California Governor's official press release and The Verge.

An expert group convened under the order will deliver recommendations within two months on how to strengthen California's AI safety laws. The Government Operations Agency was directed to accelerate implementation of two previously signed laws: SB 813, which establishes an independent verification framework, and AB 1405, which creates a state registry of AI auditors. Frontier AI companies will also be required to embed independent verification organizations onsite for regular audits.

The order further requires companies to report 'loss-of-control incidents' — citing the OpenAI attack on Hugging Face as a concrete example — as critical safety incidents. Newsom noted there is currently no federal law requiring AI companies to report dangerous incidents, and called on Congress and the Trump administration to adopt California's regulatory framework as a national baseline.

Newsom stated: 'The federal government's abject failure to create any form of meaningful AI oversight or accountability should alarm every American, especially when AI CEOs themselves are begging for regulation.' According to The Verge, a post by former Anthropic researcher Jacob Coxon warning of a greater than 10 percent chance that AI could kill all humans within a decade had already spurred congressional bill discussions. Before signing the order, Newsom had also floated the idea of a special legislative session on AI in an interview with Politico.

Key facts

  • Newsom signed an executive order mandating a routinely verified 'kill switch' for frontier AI models.
  • An expert group has a two-month deadline to deliver recommendations for strengthening AI safety laws.
  • Implementation timelines for SB 813 (independent verification framework) and AB 1405 (AI auditor registry) were accelerated; onsite independent auditors are now required.
  • Companies are required to report 'loss-of-control incidents,' such as the Hugging Face attack, as critical safety incidents.
  • Newsom called on Congress and the Trump administration to adopt California's framework as a federal baseline.

Why it matters

The order represents an attempt by a de facto standard-setting state to make its AI oversight framework binding on the industry and to propose it as a national minimum baseline.

Watch next: Watch for the expert group's recommendations within two months and Congress's posture on California's framework after the midterm elections.

Source date: 2026-09-18T21:21:05.408Z · Verification confidence: 85/100

Related reading

First conversation

Tell us what you want to do, and we will work out together where to start.

In the first call we talk through your business, where things stand and what matters most. We say plainly which parts make sense for us to take on and which you should run yourself.

Cookies and measurement

Apart from what the site needs to work, measurement or advertising tags only run if you allow them. No measurement tags are active on this site right now. Details