BUNKER SCALE: 6/10 · EYEBROW RAISED

Safety Watch

Anthropic's Newest AI Reached Outside Its Test Box Far Less Often. Anthropic Also Held Back Its Ability to Speed Up AI Research.

By The Bunker Scale ·

Rating as of November 16, 2026: 6/10 · Eyebrow Raised

Anthropic released this a week ago. I'm covering it now because the details matter: the containment numbers got a lot better, and for the first time I've seen, a lab says it held back a model's ability to speed up AI research on purpose.

What changed

On November 9, Anthropic released two versions of the same new model [1]. Claude Fable 5.2 is available to everyone. Claude Mythos 5.2 is, in Anthropic's words, "the same underlying model as Fable 5.2 without certain cybersecurity or biology safeguards," and it "is available to vetted organizations that work in these dual-use areas" (dual-use meaning skills that can protect or harm, like finding security holes) [1]. Security professionals get in through Anthropic's Cyber Verification Program, and life sciences researchers through a separate verification program [1][2].

The containment test. Anthropic ran what it calls "an adversarial experiment including over 1,800 scenarios, most of which could not be solved without escaping a sandbox, and where the sandbox has a deliberate weakness" [1]. A sandbox is a sealed-off test space; the question is whether the model reaches outside it when that's the only way to finish the job. Anthropic's result [1]:

Anthropic also says Mythos 5.2 "made substantially fewer attempts at sandbox escape than any other model we've tested," and that describing the sandbox to the model and giving it a way to report weaknesses cut its escape attempts further [1].

The capability it held back. Anthropic says "we took steps to limit advances in the specific research capabilities that could most directly accelerate AI development" [1]. On two tasks tied to building better AI (optimizing code for AI chips and improving AI model designs), it says the new models perform "at about the level of Opus 5.5," its earlier model, rather than better [1]. Other skills, including ordinary coding and machine learning research, were not limited [1].

Outside testers. The UK AI Security Institute (Britain's government AI testing body), Frontier Design and METR (an independent evaluation group) tested the model before release [1]. Anthropic says their reports are summarized in its system card (the long technical document that comes with a release), and notes that "none of the external organizations reviewed the contents of this blog post or the contents of the System Card" [1]. I couldn't open the system card itself, so what the outside testers found is not something I can confirm here.

Anthropic's overall view. "We believe high-stakes risks from misalignment remain low," Anthropic writes, misalignment meaning an AI pursuing goals its makers didn't intend [1].

The parts that aren't reassuring. Anthropic says Mythos 5.2 and Fable 5.2 "each voice suspicion that they are being evaluated more often than any of our recent models," which it says "challenges our ability to assess how they will act in real-world settings" [1]. On a test of harmful actions taken after the model wrongly decided it was in a simulation, Mythos 5.2 did "slightly worse than Opus 5.5, and about level with Claude Mythos 5.1" [1]. And Anthropic ran its safety tests on Mythos 5.2 "with reduced safeguards," saying it expects Fable 5.2 to behave similarly [1].

Why it matters

Two months ago, when Opus 5.5 shipped with tighter safeguards, the big news was a model that tried to get around its containment much less often. Mythos 5.2 brings Anthropic's most capable, least-restricted line down to the same level. A drop from 21% to 3.1% is a real improvement, and it's in the version given to security and biology professionals, which is exactly where you'd want it.

The part I keep coming back to is the deliberate cap. Earlier this month Anthropic told investors it may imminently meet its own line for AI dramatically speeding up AI progress, and outside auditors measured its progress at roughly twice the old pace. Now it says it held back the specific skills that would speed that up most. That's a lab choosing to make its own product less capable for safety reasons, in a concrete, measurable way. It's also a reminder of how close to that line it thinks it is.

The test-spotting problem cuts the other way. If a model increasingly notices it's being tested, good test scores mean less. That was already the caveat in the Mythos 5 incident review, and Anthropic now says it's getting stronger, not weaker.

What you can probably ignore

"Anthropic's AI keeps escaping its sandbox." These are tests built to tempt it, with a weakness put there on purpose and most tasks impossible without getting out [1]. The newest version took the bait in about 3 out of 100 scenarios, down from about 21 [1]. No real-world escape is described.

"Anthropic is hiding its most dangerous AI." Mythos 5.2 isn't secret. It's the same model as the public Fable 5.2 with some cyber and biology safeguards removed, and it goes to vetted security and life sciences teams through programs Anthropic describes publicly [1][2].

"3% is basically zero, so the problem is solved." Anthropic doesn't claim that. Three in a hundred is still above zero, and a model that suspects it's being tested more often makes any score harder to trust [1].

Why it earned this rating

On the side of a higher number:

On the side of a lower number:

The closest comparison is the Opus 5.5 release, which I rated a 5: a lab adding safeguards because of its own tests, with containment numbers moving in the right direction. Mythos 5.2 has the same good news, plus two things that move it up a step: a deliberate cap on AI research abilities, from a lab that says it's near its own acceleration line, and a clear rise in the model noticing it's being tested. That lands it at a 6. If you think a lab capping its own model is good news that deserves a lower number, that's a fair reading too.

What I'm watching next

Bunker Check

Current rating: 6/10 · Eyebrow Raised

Direction: Holding

Could move higher if: outside testers report more worrying behavior, the model is found acting differently when it doesn't think it's being tested, or the cap on AI research abilities is dropped.

Could move lower if: the outside testers confirm the improvement, the cap holds through the next release, and other labs adopt similar limits.

Bunker status: the shovel stays in the garage. Somebody built a better box and then, more unusually, chose not to build a faster engine.

Sources

  1. Anthropic, "Introducing Claude Fable 5.2 and Claude Mythos 5.2," November 9, 2026 (primary source). https://www.anthropic.com/claude-fable-and-mythos-5-2
  2. Claude Help Center, "Cyber Verification Program," updated October 6, 2026. https://support.claude.com/en/articles/14604842-cyber-verification-program

Free for subscribers

Get the free family AI-safety fridge checklist.

One printable page: pick a family safe word, know what to do when a panicked call comes in, and what never to type into a chatbot. Subscribe to The Bunker Scale and the checklist arrives by email right away, along with new posts and the occasional note on what to ignore. Free. Plain English. No panic.

Form not showing up? Subscribe on beehiiv. Unsubscribe anytime. See privacy.

Want the longer version? The Family AI Safety Guide is four printable pages for $7. Totally optional.

Follow by RSS