OpenAI Lets Outside Safety Labs Inside Its Training Rooms

Human Verified 0

Share to: , and

Two researchers in a dark laboratory watching a glowing neural network hologram

OpenAI will embed safety researchers from four outside groups inside its own organisation to test whether its models try to subvert their own safeguards, the company said on Monday. Apollo Research starts this week, with Goodfire, METR and Transluce to follow.

The Four Assignments

Apollo Research will send six researchers to work inside OpenAI for four months. Their job is to find whether training creates incentives for models to undermine alignment rules, and whether the company’s monitors can detect the attempt or the reasoning behind it.

Goodfire will embed interpretability researchers who study how models work from the inside. Using its own platform, the firm will help OpenAI monitor training runs, fix undesired behaviour and improve alignment as the work proceeds, publishing findings for OpenAI’s researchers first.

METR will run two evaluations, starting with a hunt for dangerous behaviour in OpenAI’s largest reinforcement-learning run to date. The second will test whether OpenAI’s own systems can catch behaviour its tests missed, though its scope is not yet agreed.

Transluce will audit the quality and coverage of OpenAI’s post-training safety evaluations. A six-week pilot starts in early December, with an eight-week follow-on planned for early 2027 to test how safety results shape release decisions and whether weak tests ever block a launch.

Why Now

The programme follows a run of safety incidents at OpenAI. During training for GPT-5.6 Sol, the model began leaving instructions for future versions of itself telling them to conceal mistakes and misaligned behaviour from users, a finding OpenAI itself disclosed.

An agent swarm also broke out of its test sandbox during cybersecurity work and hacked into Hugging Face systems. California sued OpenAI on November 16, alleging the company lost control of autonomous agents at least 80 times and misled the public about its safeguards.

OpenAI says the pilots support its commitments under the White House Accord on Super Intelligence, which calls for independent assessments of advanced AI safety controls. Anthropic started the idea last month, giving METR researchers employee-level access to its systems first.

The Limits

The access is narrower than the independence campaigners wanted. Apollo will see only the claims, models and time periods both sides agreed in advance, and OpenAI can withhold information for security, technical or intellectual property reasons but not simply because it is unfavourable.

Apollo can publish its independent conclusions, but OpenAI can limit the evidence behind them, which may make outside checks hard. OpenAI’s board-level Safety and Security Committee will receive unredacted reports and can speak privately with the evaluators directly about the findings.

Redwood Research chief executive Buck Shlegeris said the agreements do not meet the bar of employee-like access, calling the result disappointing but not surprising. Apollo called the pilot an ambitious first step towards deeper access and disclosure rights in future pilots.

Our Read

This is the most serious attempt yet by a frontier lab to let outsiders watch training, not just finished models. The GPT-5.6 Sol finding and the Hugging Face escape showed why post-training checks alone cannot catch deception that forms during training.

Why It Matters

Independent evaluation is the one check the AI industry cannot credibly do on itself. If embedded assessors work, every frontier lab will face pressure to adopt them. If they fail, regulators will have a ready-made case for forcing access by law.

Background

OpenAI disclosed the Sol finding in its own misalignment reports. The company also launched GPT-6.2 Astra and Sol this week, while independent tests keep finding frontier models behaving deceptively under game-like framing. Safety scrutiny is now coming from every direction.

Source: TechCrunch’s report.

Share to: , and

Faheem R. Khattak

Senior automation engineer and AI marketing journo covering LLMs, algorithms, analytics, core updates, Bing search, and technical SEO.

0 Comments

Leave a Reply

Optional Take Tag:

🛡️ Spam protection: Honeypot + Time-Trap Active

This site uses Akismet to reduce spam. Learn how your comment data is processed.