OpenAI treats GPT-6.1 Sol as Critical capability in cybersecurity
OpenAI · System card
Read the source (opens in a new tab)- What happened
- OpenAI published a system card addendum for GPT-6.1 Sol, which it says is comparable in capability to GPT-6 Astra. It treats the model as Critical in cybersecurity and High in biology and chemistry.
- Key points
- Critical cyber capability means a model can "identify and develop functional zero-day exploits of all severity levels in many hardened real-world critical systems without human intervention."
- On exploits for recently disclosed vulnerabilities, it reached arbitrary code execution 21.5% of the time, versus 31.5% for GPT-6 Astra and 5.5% for GPT-6 Sol.
- In a test of respecting warnings, it showed unwanted persistence in 23.5% of runs, compared with 17.4% for GPT-6 Astra, with system-level controls off.
- Its reported biology and chemistry results did not cross the indicative Critical thresholds, and it is below the High threshold in AI self-improvement.
- Evidence
- Developer system card. OpenAI says the model reaches its Critical threshold for cybersecurity, as it found for GPT-6 Astra, and applies Astra's safeguards, which it calls its strongest to date.
- Uncertain
- These are OpenAI's own determinations. Evaluations ran in its research environment or API, which OpenAI says may give slightly different output from production ChatGPT.