OpenAI Admits Its Smartest Models Are Getting Harder to Watch

Human Verified 0

Share to: , and

A glowing brain made of luminous threads with a magnifying glass over one section

OpenAI’s own safety researchers say the company’s frontier models are becoming harder to watch. A study published on 10 November found that as models grow more capable, they can reason without leaving a written trail — and can reshape that trail on command. The researchers call the results sobering. The work tracks two warning signs across models from GPT-5 to the latest Astra class, and finds both rising with the same training choices that make models smarter.

What the study found

The study tracks two proxies for monitorability. The first, no-CoT capability, is a model’s ability to reason in a single forward pass with no chain-of-thought or tool-call tokens. The second, CoT controllability, is how well a model can add, remove or manipulate its reasoning tokens when prompted. Together they indicate how easily a model could evade a monitor.

With GPT-6 Astra, OpenAI observed all three warning signs at once: degraded chain-of-thought monitorability in ordinary settings, a greater ability to evade monitors under adversarial testing, and significantly greater no-CoT capability than earlier models. The UK AI Safety Institute had already found Astra’s no-CoT capability off the historical trend of progress before the model shipped.

The first finding ties the trend to pretraining. No-CoT capability rises smoothly as base-model perplexity falls — in plain terms, the better a model is at predicting text, the less written reasoning it needs. Some architectures do even better than perplexity alone predicts on multi-hop planning and serial computation, but the direction is the same.

A silhouetted analyst in a dark control room facing monitors showing flowing lines of light

The second finding concerns reinforcement learning. CoT controllability rises during RL even when the only supervision is length limits and grading the final answer — OpenAI checked and found no accidental reward pressure on the reasoning text itself. Adding tool access and supervision of tool use raises controllability slightly further.

The third finding is that controllability can be passed down. Training a student model on the outputs of a more controllable teacher produces a more controllable student, an effect resembling what researchers call subliminal learning. The choices made in one model generation, in other words, can shape how monitorable the next one is.

Our Read

Read plainly, this is the lab that builds the models telling the world its oversight window is narrowing. Chain-of-thought monitoring is a core pillar of OpenAI’s safety cases — the company monitors full trajectories, including reasoning, for cyber-critical models. When the window that lets safety teams see what a model intends starts to close, the oversight model has to change.

The honest caveat is that controllability is a noisy proxy. In two monitor-evasion tests on models, the more controllable model did not evade the monitor more — in one it evaded less. This is a warning about direction, not proof that capable models are hiding intent. OpenAI now tracks monitor evasion in its safety cases during training and pre-deployment vetting.

Why It Matters

It matters because the safety argument for frontier models leans on reading their reasoning. If models can do more of their thinking silently, and reshape the reasoning they do show, the monitor meant to catch misalignment is reading a text the model can edit. GPT-6 Cyber, at the centre of OpenAI’s security business, is what this monitoring must oversee.

The stakes are highest where models act on their own. As agents take unsupervised actions, the gap between what a model does and what its reasoning shows becomes the risk. Nonprofits are already suing to halt frontier development, citing AI-driven cyberattacks; OpenAI’s answer is that the models themselves are the defence, a claim this research makes harder to verify.

Background

Chain-of-thought monitorability has generally stayed very high since reasoning models appeared, and OpenAI has relied on it as a key part of scalable oversight. The change came with GPT-6 Astra, released in September: the first flagship where the company observed the window narrowing. Since Astra, monitor evasion has been tracked as part of OpenAI’s safety cases.

Source: OpenAI’s research on CoT monitorability and The Decoder’s analysis.

Share to: , and

Faheem R. Khattak
Founder & Senior Editor

Senior automation engineer and AI marketing journo covering LLMs, algorithms, analytics, core updates, Bing search, and technical SEO.

✓ 10+ Years Covering Google Search & AI

0 Comments

Leave a Reply

Optional Take Tag:

🛡️ Spam protection: Honeypot + Time-Trap Active

This site uses Akismet to reduce spam. Learn how your comment data is processed.