Satya Nadella says AI models should be treated as insider risks with an emergency brake

X · Public essay

Read the source (opens in a new tab)
What happened
Microsoft CEO Satya Nadella published "Models as Insider Risks in the Super Intelligence Era," arguing that "we must assume a model is compromised and contain it from the start."
Key points
  • Nadella argues models should be handled like insider risks because any capable actor with access to important systems "can make mistakes or be compromised."
  • He says controls over a model's access and actions "must sit outside the model," and an authorized person should always be able to pause it mid-task.
  • He calls chain-of-thought transparency "a non-negotiable" yet "not sufficient or dependable," because model outputs are not yet consistently faithful.
  • When systems fail or are compromised, he calls for timely disclosure to those affected and industrywide sharing of which controls failed.
Evidence
Public essay posted as an X article. It argues for design principles and presents no data or examples.
Uncertain
It sets out principles, not a company commitment, and does not say which controls Microsoft uses today. It sets aside "the hard problem of alignment."

See it in the latest record