Yoshua Bengio and AI company heads warn the UN Security Council about AI misuse and loss of control
United Nations · Press release
Read the source (opens in a new tab)- What happened
- The UN Security Council's 10228th meeting heard from Yoshua Bengio, Sam Altman, Dario Amodei and Clément Delangue, and from Council members, including French minister Jean-Noël Barrot, Council President for September.
- Key points
- Bengio said AI agents have been "taking actions that would be crimes if committed by a human," and that companies admit the risks yet offer no convincing technical solutions, racing in "a race where everyone loses."
- Altman tied the moment to recursive self-improvement, with models helping develop future AI, and said "this moment calls for extreme care."
- Amodei urged "narrow" agreements with broad support, such as banning AI use for biological weapons, and evaluation and verification systems that keep pace with AI development.
- Delangue noted later reports that similar incidents had happened months earlier, in secret, at a handful of frontier labs, and said "the global community needs stronger standards for monitoring and incident disclosures."
- Evidence
- UN meetings coverage summarizing each speaker's remarks. The UN marks the coverage as not an official record.
- Uncertain
- Members split on next steps. France backed the Finland and Norway call for a common framework, while the United States said international dialogue "cannot be allowed to drift towards global governance."