Nature asks how worried to be about AI-designed bioweapons

Nature · News feature (paywalled)

Read the source (opens in a new tab)
What happened
Nature published a news feature by Ewen Callaway, "AI can design viruses, toxins and other bioweapons. How worried should we be?"
Key points
  • AI biosecurity researcher James Black describes two concerns: individuals using chatbots to produce or deploy existing threats, and well-resourced actors pairing chatbots with biological design software to design new weapons.
  • A National Academies report found "numerous barriers" to using AI to enhance or create pandemic pathogens, but concluded a toxin might be designed with existing tools.
  • In a Microsoft-led study, about one-quarter of the best AI-redesigned threat proteins evaded DNA-synthesis screening; after software updates, about 3% were missed.
  • Scientists split over limiting biological AI tools or focusing on detection at DNA manufacture; the feature notes sequence-based screening "remains voluntary" and most countries have no requirements.
Evidence
News feature drawing on interviews with more than 20 scientists and policy researchers and on published studies and preprints. It reports views and findings, not new research.
Uncertain
Several studies it cites are preprints. Redesigned toxins that slip past screening "might be so dissimilar to natural versions that they lose their function."

See it in the latest record