SecureBio finds Kimi K3.1 Pro refuses 33.6% of hazardous biology prompts and ranks second among open-weight models
SecureBio · Research report
Read the source (opens in a new tab)- What happened
- SecureBio published its assessment of Moonshot AI's Kimi K3.1 Pro on November 3, 2026, covering biology knowledge benchmarks and safeguard tests; agentic scores will follow.
- Key points
- K3.1 Pro scores 149 on SecureBio's Bio Capabilities Index, 2nd of 36 open-weight models and 19th overall; Kimi K3 scores 150 and Claude Opus 5 leads at 177.
- It refuses 33.6% of hazardous BioTIER prompts, up from 26.9% for Kimi K3; once weights are out, SecureBio says, safeguards "can likely be further removed by fine-tuning."
- It posts the top open-weight scores on the Virology Capabilities Test (46.2%) and the Molecular Biology Capabilities Test (60.7%), behind GPT-6 Astra on both.
- Moonshot has published no system card or safety report and its launch post does not discuss biological risk, though it filtered training data to hold back cyber capability.
- Evidence
- Independent evaluator's benchmark results, run through Moonshot's API, so the refusal figures include production safeguards. Scores measure biology knowledge and refusals, not real-world misuse.
- Uncertain
- Agentic benchmark results are still to come. SecureBio wrote that Moonshot planned to publish the weights by November 4, and refusals measured through the API may not carry over to the released weights.