Nature asks how worried to be about AI-designed bioweapons
Nature · News feature (paywalled)
Read the source (opens in a new tab)- What happened
- Nature published a news feature by Ewen Callaway, "AI can design viruses, toxins and other bioweapons. How worried should we be?"
- Key points
- AI biosecurity researcher James Black describes two concerns: individuals using chatbots to produce or deploy existing threats, and well-resourced actors pairing chatbots with biological design software to design new weapons.
- A National Academies report found "numerous barriers" to using AI to enhance or create pandemic pathogens, but concluded a toxin might be designed with existing tools.
- In a Microsoft-led study, about one-quarter of the best AI-redesigned threat proteins evaded DNA-synthesis screening; after software updates, about 3% were missed.
- Scientists split over limiting biological AI tools or focusing on detection at DNA manufacture; the feature notes sequence-based screening "remains voluntary" and most countries have no requirements.
- Evidence
- News feature drawing on interviews with more than 20 scientists and policy researchers and on published studies and preprints. It reports views and findings, not new research.
- Uncertain
- Several studies it cites are preprints. Redesigned toxins that slip past screening "might be so dissimilar to natural versions that they lose their function."