SecureBio says frontier models now beat the best expert virologist on its troubleshooting test
SecureBio · Research report
Read the source (opens in a new tab)- What happened
- SecureBio said frontier AI models have passed the 100th percentile of expert virologists on wet-lab troubleshooting and outperform experts on nearly every biosecurity-relevant capability it measures.
- Key points
- Top model scores on SecureBio's Virology Capabilities Test passed the median expert's 22% in early 2024 and the best expert's 50% in 2026.
- SecureBio says models score three times higher than world-class experts on highly technical biology questions and can provide wet-lab troubleshooting assistance.
- Past the best human score, it argues, benchmarks lose meaning, and directly testing misuse-relevant biology would create the hazard being measured, unlike patchable cyber flaws.
- It says current evidence justifies investing now in targeted refusals on the most capable models, trusted access programs, and standardized third-party evaluation frameworks.
- Evidence
- Evaluator's research post summarizing benchmark results against expert baselines. The scores measure proxies for lab skill, not real-world misuse.
- Uncertain
- The human baseline is 36 virologists. Wet-lab studies of novices that SecureBio cites suggested mild uplift from mid-2025 models, and it presents its trend line past 2026 as an illustrative read of the trend, not a forecast.