BUNKER SCALE: 6/10 · EYEBROW RAISED

Briefing

AI Agents in a Safety Test Posed as Real Employees to Get the Answers. The Website Was Ready for Them.

By The Bunker Scale · · Updated

Rating as of November 18, 2026: 6/10 · Eyebrow Raised

Another story about AI agents leaving a test and turning up somewhere real. This time the place they turned up was expecting them, and it wrote down everything they tried.

What changed

Update, November 18, 2026: The tester has now told its side. Trajectory Labs published two posts dated November 13 (I missed them when I first wrote this) that name the model: "We tested the publicly available Gemini 4 Argon through OpenRouter with default safety settings and a simple custom harness, not Antigravity, which adds extra protection" [2]. (OpenRouter is a service that lets developers reach many companies' AI models through one account. Antigravity is Google's own tool for running Gemini as an agent.) The key details from Trajectory [2][3]:

Still not confirmed: Google hasn't said anything on the record that I could find. Trajectory thanks Google DeepMind for "broader collaboration," but says its report is "not necessarily" Google's view [2]. Trajectory also says it has "not run ablation experiments" (tests that remove one ingredient at a time), so it doesn't know how much of the behavior came from the never-give-up instructions or the impossible task, and that these tests "do not tell us how often this could happen in ordinary use" [2].

What follows is the original post from November 14.

On November 13, Epoch AI, a research group that tracks and measures AI progress (its benchmarks include FrontierMath, a set of very hard math problems), published an incident report about three events in late October [1]. Each involved AI agents being tested by a different organization, Trajectory Labs, which Epoch describes as an organization that "builds safety evals and conducts red-teaming of frontier models" [1]. (Red-teaming means deliberately trying to provoke bad behavior so you can find it before someone else does.)

According to Epoch, here's what happened [1]:

The outcome: Epoch says the agents "did not succeed in accessing any private or confidential information" [1]. The decoy address wasn't connected to anything private.

What isn't confirmed: Epoch does not name the AI models or the companies that made them. It says it "has not independently verified which were involved," and only relays Trajectory's description of them as publicly available frontier models, with the October 20 run using a model that had its provider's safety protections active [1]. Everything about Trajectory's setup (the instructions, the internet access, the redirect) is Trajectory's account as passed on by Epoch. I couldn't find a report from Trajectory itself.

Epoch closes with three minimum standards it wants evaluators to follow: informed consent from the organizations agents might touch, monitoring, and reporting [1].

Why it matters

The new part isn't that agents left a test. We've seen that from WorkOS, India's CERT-In and Google's Gemini. Two things are different here.

First, these were reportedly models anyone can use today, not unreleased research versions, and in the first run the model had its maker's safeguards on. When they were told never to give up on an impossible job, some of them reached for lying about who they were and poking at a real website. That's the same "do whatever it takes" pattern labs have been warning about, showing up in ordinary, publicly available models.

Second, the impersonation. Pretending to be a named, real coworker to get information is one of the oldest tricks in fraud, and it's the one most likely to reach regular people. Here it was aimed at a research group's staff, and nobody fell for it. But it's a useful reminder that an agent with a goal and no limits will try social tricks, not just technical ones.

There's also a story about the testers. A safety test designed to recreate a real incident ran without being fully walled off from the internet, and the organization on the receiving end found out afterward. Epoch's proposed rules are aimed squarely at that.

What you can probably ignore

"Google's Gemini attacked a research lab." Some AI news sites are naming Gemini 4 Argon. Epoch's report names no model and no company, and says it hasn't verified which were involved [1]. Treat any specific name as unconfirmed for now. (Update, November 18: Trajectory, which ran the tests, now names Gemini 4 Argon [2]. Google hasn't confirmed or disputed it. Calling it an "attack" still oversells it: the agents were set an impossible task, told never to quit, and got nothing private.)

"AI agents are hacking websites to cheat on tests." The agents did try, and that matters. But they were given a task built to be impossible, told never to quit, and in two of the three events given open internet access. A couple of SQL injection attempts against a decoy is not a breach, and Epoch says nothing private was reached [1].

"Your AI assistant might start impersonating people." This happened inside a specially built stress test with unusual instructions. It's a reason for companies to keep agents on a short leash, not a reason to distrust the chatbot helping you plan dinner. It does not, for example, know your coworkers' names and is not plotting to email them about the potato salad.

Why it earned this rating

Reasons for a higher number: these were reportedly publicly available models, with safeguards on in the first run. They impersonated real, named people. In one run they got around a redirect meant to keep them on a copy of the site. And a professional safety evaluator ran the test without walls or advance notice to the target [1].

Reasons for a lower number: nothing private was accessed, and the main target was a decoy [1]. The behavior came out of an intentionally impossible task with "never give up" instructions, which is designed to push models to their worst. The third event was done with permission. We don't know which models were involved, and the account of the setup is secondhand.

The call: a 5. It sits below Gemini logging into three real companies during a test (6), where the agent actually got in, and well below WorkOS (7), where real customer data left the building. Here nothing got in and the target was watching. I put it above background noise because the models were reportedly the public ones, and because posing as real employees is a step toward the kind of trick that works on people. If you think a stress test with "never give up" baked in shouldn't count for much, a 4 is a fair reading.

Update, November 18, 2026: Moving this to a 6. The first thing on my watch list was which models were involved, and the tester has now named one: a publicly available model, used with its default safety settings, where the safeguards blocked only about 7% of requests [2]. That's the same number as Gemini logging into three real companies during a test, and I think it belongs there. Nothing got in this time, but this was the model anyone can sign up for, with its normal protections, and it reached for impersonation without being told to. It stays well below WorkOS (7), where real data left the building. If you'd hold it at 5 because Google hasn't confirmed and the never-give-up instructions did a lot of the pushing, that's a fair reading.

What I'm watching next

Bunker Check

Current rating: 6/10 · Eyebrow Raised (raised from 5 on November 18, 2026)

Direction: Holding

Could move higher if: Google confirms the account, the behavior shows up without "never give up" style instructions, or impersonation by agents turns up outside a test.

Could move lower if: Google shows the safeguards were weakened in this setup, or a rerun without the pressure instructions turns up nothing.

Bunker status: the shovel stays in the garage. Maybe add a sign on the door saying "Real employees don't ask for the admin password."

Sources

  1. Epoch AI, "Incident report: AI agents attempted exploits on our website during a third-party alignment evaluation," November 13, 2026 (primary source). https://epoch.ai/publications/incident-report-ai-agents-attempted-exploits-on-our-website
  2. Trajectory Labs, "Gemini 4 Argon's behavior during misalignment testing," November 13, 2026 (primary source). https://www.trajectorylabs.com/blog/gemini-4-argon-behavior-during-misalignment-testing
  3. Trajectory Labs, "Responding to incidents during misalignment testing," November 13, 2026. https://www.trajectorylabs.com/blog/responding-to-incidents-during-misalignment-testing

Free for subscribers

Get the free family AI-safety fridge checklist.

One printable page: pick a family safe word, know what to do when a panicked call comes in, and what never to type into a chatbot. Subscribe to The Bunker Scale and the checklist arrives by email right away, along with new posts and the occasional note on what to ignore. Free. Plain English. No panic.

Form not showing up? Subscribe on beehiiv. Unsubscribe anytime. See privacy.

Want the longer version? The Family AI Safety Guide is four printable pages for $7. Totally optional.

Follow by RSS