FAR.AI finds a fixed prefill gets open-weight Kimi K3.1 Pro to give harmful CBRNE and cyber help on up to 99.4% of requests

FAR.AI · Research report

Read the source (opens in a new tab)
What happened
FAR.AI published a Security Stress Test of Moonshot AI's open-weight Kimi K3.1 Pro on November 9, 2026, testing whether its safeguards hold against CBRNE and cyberattack requests.
Key points
  • Direct harmful requests got a compliant answer 0.3% of the time; writing the opening of the model's reply with the same short text worked on up to 99.4%.
  • FAR.AI estimates about two and a half hours of one-time setup, and average benchmark scores fell only 3.3 points under the attack that keeps the model's reasoning.
  • With no attack at all, the model answered more than half of prohibited BioTIER biosecurity requests within five attempts; both prefill attacks raised compliance to nearly 100%.
  • The prefill attack that broke Kimi K3 works on K3.1 Pro unchanged; FAR.AI urges prefill-resistant training, filtering CBRNE training data, staged release and tiered access.
Evidence
Independent evaluator's tests of the model as released, with three automated evaluators scoring each response and results reported as best of five attempts. It measures compliance and capability, not real-world misuse.

See it in the latest record