Satya Nadella says AI models should be treated as insider risks with an emergency brake
X · Public essay
Read the source (opens in a new tab)- What happened
- Microsoft CEO Satya Nadella published "Models as Insider Risks in the Super Intelligence Era," arguing that "we must assume a model is compromised and contain it from the start."
- Key points
- Nadella argues models should be handled like insider risks because any capable actor with access to important systems "can make mistakes or be compromised."
- He says controls over a model's access and actions "must sit outside the model," and an authorized person should always be able to pause it mid-task.
- He calls chain-of-thought transparency "a non-negotiable" yet "not sufficient or dependable," because model outputs are not yet consistently faithful.
- When systems fail or are compromised, he calls for timely disclosure to those affected and industrywide sharing of which controls failed.
- Evidence
- Public essay posted as an X article. It argues for design principles and presents no data or examples.
- Uncertain
- It sets out principles, not a company commitment, and does not say which controls Microsoft uses today. It sets aside "the hard problem of alignment."