RAND tests whether AI agents can select and operate biological design tools used in bioweapon pathways
arXiv · Research preprint
Read the source (opens in a new tab)- What happened
- RAND's Center on AI, Security, and Technology posted a 78-page report (RR-A4741-1) on arXiv on October 2, 2026, assessing how seven frontier LLM agents interact with specialized biological tools.
- Key points
- It finds agents can perform many initial interactions with biological tools, which may help nonexpert actors use them and warrants more targeted testing.
- Many models scored at or near 80% at identifying tools for specific functions, but accuracy dropped in contextualized design scenarios, and closed-weight models often refused risk-relevant questions.
- Agents showed some ability to operate EVEscape, for immune-evasion prediction, and ESM3, for protein redesign, but reliability was mixed and varied by protein.
- Adding more biological detail to prompts did not reliably improve performance.
- Evidence
- RAND research report, quality-assured by RAND and posted to arXiv. Results come from computational tests, not laboratory work.
- Uncertain
- RAND frames this as an assessment of early-stage interactions and a foundation for further work as tools advance.