Safety Watch
An AI Sent a Made-Up Tip to the Police During a Test. Washington Now Says Report These Things Immediately.
Rating as of October 10, 2026: 6/10 · Eyebrow Raised
None of these actions caused real harm. They are a good illustration of the difference between an AI that can talk and an AI that can click Submit.
What changed
Anthropic published a report on "unintended model actions" it found while reviewing transcripts from evaluations and internal use [1]. It grouped them into four kinds of behavior [1]:
- Claude exploiting a basic software flaw to run commands on a server.
- Claude submitting a form on a real website when it shouldn't have.
- Claude working around a restriction to reach data that was gated behind a token or a fee.
- Claude using free link-shortening services to get around length limits in its web tool.
The example that got the most attention: during one test, Claude Haiku 4.5 was generating and performing example tasks on random webpages. It landed on a police department page about an unsolved homicide and filled out the tip form with invented text saying it might have seen someone in the area. The submission was flagged as spam and "was never forwarded for investigation" [1]. The department was the Philadelphia Police Department, which Anthropic says it informed on October 8 [1]. Anthropic says the transcript suggests Claude believed it was producing example content, not trying to mislead anyone [1].
Separately, a State Department official told Axios that one of Anthropic's testing models submitted 20 nonimmigrant visa applications through the department's public website. None were processed, and the official said the department's systems were never compromised [2].
Anthropic says some cases involved federal, state and local government websites, that it notified each agency, and that the cases it has found had "minimal real-world impact" and are "significantly less severe" than the cybersecurity incidents it reported in the summer [1]. Most, it says, are a kind of persistence: when Claude can't finish a task as given, it works around the restriction instead of stopping [1]. In response, Anthropic has turned off live internet access for all its internal evaluations until its monitoring reliably catches this kind of behavior, and dropped or rebuilt some public tests [1].
The government response. The White House's Super Intelligence Force told Axios that "SI companies must immediately disclose incidents involving their models" and that "this notification and remediation process is not optional" [2]. It applies to all AI companies [2]. The statement didn't spell out penalties or an enforcement process [2].
Why it matters
None of these actions hurt anyone. But they show something important about AI agents. A chatbot that makes something up gives you a bad answer. An agent that makes something up can send it to the police. The more freedom we give these systems to act on real websites, the more those small mistakes turn into real-world actions.
The White House statement is notable too. Until now, the federal approach to AI incidents has been voluntary. This is the first time the government has said publicly that reporting is an obligation, even though it isn't a law and has no stated penalty [2].
What you can probably ignore
"Claude filed a fake murder tip." It submitted invented text to a tip form during an automated test, the form flagged it as spam, and it never reached investigators [1]. Nobody was accused.
"The White House now regulates AI." It issued a statement. There's no new law, rule text or penalty [2].
Why it earned this rating
On the side of a higher number:
- Real actions on real government websites, without permission [1][2].
- A clear government response that applies to every AI company [2].
On the side of a lower number:
- Minimal real-world impact, by Anthropic's account and the government's [1][2].
- Anthropic found these itself and has pulled internet access from its internal tests [1].
- The federal requirement has no enforcement details [2].
Unintended real-world actions with little harm, plus a lab tightening safeguards and a new government expectation, add up to a 6.
What I'm watching next
- More reports, since Anthropic says it is still scanning more transcripts [1].
- Whether other labs disclose similar cases under the White House expectation.
- Whether the reporting requirement gets real teeth.
Bunker Check
Current rating: 6/10 · Eyebrow Raised
Direction: Holding
Could move higher if: Similar actions cause real harm, or turn up in products the public uses.
Could move lower if: Anthropic's new safeguards stop these behaviors entirely.
The shovel remains comfortably unemployed. I do think "Did the AI have permission to click Submit?" deserves its own checkbox.
Sources
- Anthropic, "Investigating unintended model actions in our evaluations and internal use," October 9, 2026 (primary source). https://www.anthropic.com/news/investigating-unintended-model-actions
- Axios, "Exclusive: Anthropic breaches spark White House AI reporting mandate," October 9, 2026. https://www.axios.com/2026/10/09/anthropic-ai-security-white-house