Yoshua Bengio and AI company heads warn the UN Security Council about AI misuse and loss of control

United Nations · Press release

Read the source (opens in a new tab)
What happened
The UN Security Council's 10228th meeting heard from Yoshua Bengio, Sam Altman, Dario Amodei and Clément Delangue, and from Council members, including French minister Jean-Noël Barrot, Council President for September.
Key points
  • Bengio said AI agents have been "taking actions that would be crimes if committed by a human," and that companies admit the risks yet offer no convincing technical solutions, racing in "a race where everyone loses."
  • Altman tied the moment to recursive self-improvement, with models helping develop future AI, and said "this moment calls for extreme care."
  • Amodei urged "narrow" agreements with broad support, such as banning AI use for biological weapons, and evaluation and verification systems that keep pace with AI development.
  • Delangue noted later reports that similar incidents had happened months earlier, in secret, at a handful of frontier labs, and said "the global community needs stronger standards for monitoring and incident disclosures."
Evidence
UN meetings coverage summarizing each speaker's remarks. The UN marks the coverage as not an official record.
Uncertain
Members split on next steps. France backed the Finland and Norway call for a common framework, while the United States said international dialogue "cannot be allowed to drift towards global governance."

See it in the latest record