SecureBio says frontier models now beat the best expert virologist on its troubleshooting test

SecureBio · Research report

Read the source (opens in a new tab)
What happened
SecureBio said frontier AI models have passed the 100th percentile of expert virologists on wet-lab troubleshooting and outperform experts on nearly every biosecurity-relevant capability it measures.
Key points
  • Top model scores on SecureBio's Virology Capabilities Test passed the median expert's 22% in early 2024 and the best expert's 50% in 2026.
  • SecureBio says models score three times higher than world-class experts on highly technical biology questions and can provide wet-lab troubleshooting assistance.
  • Past the best human score, it argues, benchmarks lose meaning, and directly testing misuse-relevant biology would create the hazard being measured, unlike patchable cyber flaws.
  • It says current evidence justifies investing now in targeted refusals on the most capable models, trusted access programs, and standardized third-party evaluation frameworks.
Evidence
Evaluator's research post summarizing benchmark results against expert baselines. The scores measure proxies for lab skill, not real-world misuse.
Uncertain
The human baseline is 36 virologists. Wet-lab studies of novices that SecureBio cites suggested mild uplift from mid-2025 models, and it presents its trend line past 2026 as an illustrative read of the trend, not a forecast.

See it in the latest record