OpenAI treats GPT-6.1 Sol as Critical capability in cybersecurity

OpenAI · System card

Read the source (opens in a new tab)
What happened
OpenAI published a system card addendum for GPT-6.1 Sol, which it says is comparable in capability to GPT-6 Astra. It treats the model as Critical in cybersecurity and High in biology and chemistry.
Key points
  • Critical cyber capability means a model can "identify and develop functional zero-day exploits of all severity levels in many hardened real-world critical systems without human intervention."
  • On exploits for recently disclosed vulnerabilities, it reached arbitrary code execution 21.5% of the time, versus 31.5% for GPT-6 Astra and 5.5% for GPT-6 Sol.
  • In a test of respecting warnings, it showed unwanted persistence in 23.5% of runs, compared with 17.4% for GPT-6 Astra, with system-level controls off.
  • Its reported biology and chemistry results did not cross the indicative Critical thresholds, and it is below the High threshold in AI self-improvement.
Evidence
Developer system card. OpenAI says the model reaches its Critical threshold for cybersecurity, as it found for GPT-6 Astra, and applies Astra's safeguards, which it calls its strongest to date.
Uncertain
These are OpenAI's own determinations. Evaluations ran in its research environment or API, which OpenAI says may give slightly different output from production ChatGPT.

See it in the latest record