Anthropic Gave Outside Safety Testers a Desk Inside the Building

Rating as of October 18, 2026: 4/10 · Worth Watching

For once, the development isn't a new failure. It's a safety response, and a fairly concrete one.

What changed

Anthropic announced that it has started giving "employee-like access" to a team from METR, a nonprofit that evaluates frontier AI models [1]. CNBC, TechCrunch and Reuters covered it [2][3][4].

What that means, according to Anthropic [1]:

• Six METR employees have company hardware, office space, and access to internal tools and systems "roughly on par" with what Anthropic's own risk assessment teams have.
• Anthropic employees are encouraged to share information with them as they would with a colleague, outside a few defined categories like customer data, legal advice and details of model architecture.
• METR will publish its analysis of Anthropic's risk levels, incidents and practices. Anthropic says it "can't veto publication," though it can require redactions in predefined categories.
• Anthropic is also working with SecureBio and Accenture as evaluators, and is in early talks with others, including Hugging Face.

Anthropic compares the idea to bank supervision, where regulators place examiners inside the largest banks because the banks know more about their own risks than outsiders do [1].

Why it matters

Most outside testing of AI so far has looked like this: a lab hands an evaluator a nearly finished model shortly before release, and the evaluator tests what it can in the time it has. This is different. Outside researchers get sustained access to the inside of the process, and the right to tell the public what they see.

METR has relevant history here. In earlier work, it found that Anthropic's monitoring systems at the time "could be circumvented in a variety of ways by agents and had important coverage limitations," and it says it expects such issues to be common across companies [5]. That's the kind of finding you want an independent group to be able to publish.

What you can probably ignore

"Anthropic is now independently regulated." METR's own proposal is clear that access is at the company's discretion, the company can deny requests and redact information, and METR won't have the same access as senior employees [5]. It also has no power to stop a release. This is oversight by agreement, not by law.

"This means Anthropic's models are safe." It means someone outside will be checking. That's different.

Why it earned this rating

This one works a little differently, because it's a step that lowers risk rather than raising it.

Reasons it matters:

• Independent evaluators with deep, ongoing access and freedom to publish [1].
• It responds directly to the summer's incidents, where outside visibility was poor.

Reasons to keep expectations modest:

• The company still controls access and can redact [1][5].
• No results have been published yet.
• It covers one company.

I'm calling this a 4. Something real happened and it deserves attention, but its effect on actual risk depends on what METR finds and whether other labs follow. Our scale measures how much a development changes the picture, and this change is in the right direction.

What I'm watching next

• METR's first published findings from inside Anthropic.
• Whether OpenAI, Google and others agree to similar arrangements.
• What gets redacted, and whether METR reports that publicly, as it says it intends to [5].

Bunker Check

Current rating: 4/10 · Worth Watching

Direction: Holding

Could move higher if: Other labs adopt similar access, or METR's reports surface problems that get fixed.

Could move lower if: Access gets restricted in practice, or the arrangement fades away.

The people checking whether the AI is safe are starting to include people who don't work for the company building it. That's one velvet rope I'm happy to see go.

Sources

1. Anthropic, "An update on independent evaluators," October 15, 2026 (primary source). https://www.anthropic.com/news/an-update-on-independent-evaluators
2. CNBC, "Anthropic taps METR and SecureBio to help assess risks and safety," October 15, 2026. https://www.cnbc.com/2026/10/15/anthropic-metr-securebio-ai-safety-evaluators.html
3. TechCrunch, "Anthropic is letting METR researchers look under the hood with employee-level access," October 15, 2026. https://techcrunch.com/2026/10/15/anthropic-is-letting-metr-researchers-look-under-the-hood-with-employee-level-access/
4. Reuters (via Investing.com), "Anthropic grants outside evaluator METR employee-level access in AI safety push," October 2026. https://www.investing.com/news/economy-news/anthropic-grants-ai-evaluator-metr-employeelevel-access-to-its-models-4952420
5. METR, "A proposal for better informing the public about loss-of-control risks from frontier AI development," October 14, 2026 (primary source). https://metr.org/blog/2026-10-14-better-informing-the-public-about-loss-of-control-risks/