OpenAI says activation probes now monitor its most capable models and can halt responses mid-generation
OpenAI · Research report
Read the source (opens in a new tab)- What happened
- OpenAI described on November 2, 2026, the activation classifiers, or probes, that it has run on assistant completions since GPT-5.6, on internal and external traffic of its most capable models.
- Key points
- Probes read the model's internal activations token by token; above a threshold, streaming stops, a reasoning model reviews the message, and tool calls stay blocked until marked safe.
- In OpenAI's red-teaming, probes were "overall more robust to jailbreaks than content-based classifiers," and their performance keeps improving on its frontier models.
- Probes "complement other safeguards rather than replace them": they detect only what they are trained to detect and must be retrained for each new base model.
- They are one part of OpenAI's internal misalignment monitoring, alongside model-based review, automated investigation and human response.
- Evidence
- Company research post describing its own deployed safeguard. OpenAI says the figures come from internal experiments and "are not necessarily representative of deployed classifiers."
- Uncertain
- Robustness results come from OpenAI's own testing. It says robustness is highest against jailbreaks not optimized against the probe, and that real-world attacks can adapt.