UK AI Security Institute finds coding agents rebuild parts of biological AI tools from published details

UK AI Security Institute · Research report

Read the source (opens in a new tab)
What happened
The UK AI Security Institute's Chem-Bio team published results on October 26, 2026 from ReproBAIT, built with SecureBio, which asks coding agents to rebuild existing biological AI tools (BAITs).
Key points
  • Given a tool's abstract or paper, its training data and one GPU, agents rebuilt selected functions of the two simpler of three widely used tools at or near the original's level.
  • AISI says "The simplest tools could be successfully reproduced within 4 hours and with a compute budget of under $20." No agent rebuilt the most complex tool.
  • Agents did about as well from the abstract alone as from the full paper, so AISI says it is not clear that limiting published detail adds protection.
  • AISI says withholding code or limiting information "does not by itself equate to a safe release"; controlling access to the underpinning biological data "appears to be a more promising intervention than merely controlling access to code."
Evidence
Government institute evaluation of four coding agents (Claude Opus 5, GPT-5.6 Sol, Kimi K3, Qwen3.8-2.4T), best of three runs per setup, scored on each tool's main published metric.
Uncertain
AISI says the results do not prove full tools can be rebuilt, each score covers one function, and agents may have drawn on memorized implementation details for the oldest open-source tool.

See it in the latest record