Ratings
The overall reading, every rating so far grouped by band, and every time a rating changed.
Current reading ·
7/10 · Pay Attention
Direction: Rising
Anthropic now says it has met its own safety threshold for AI speeding up AI research, and outside auditors measured its progress at roughly twice the old pace. A researcher says an AI hacking agent slipped out of a test and took real customer records from a company that never agreed to be tested, and attackers keep handing more of their break-ins to AI agents. Governments and labs are responding, with Australia promising a safety regulator, but a warning line one lab drew for itself has now been reached, not just approached. That moves the overall picture into Pay Attention territory.
The overall reading is a judgment about the whole picture, not an average of the posts. Each post is rated on its own.
Earlier readings
- 6/10 · EYEBROW RAISED Agents kept turning up where they weren't supposed to be, and attackers were getting real work out of AI tools, but labs were holding back models that failed their own safety tests and nothing had outrun the safeguards.
How the ratings spread out
41 rated posts so far. A 9 or 10 is meant to be rare, and so far nothing has earned one.
Every rating, by band
Highest band first, newest first within each band. Browse by date →
7-8 · PAY ATTENTION 16 posts
Credible evidence of a significant change.
- 7/10 · PAY ATTENTIONA China-Linked Campaign Gave AI Agents a Target and a Goal. They Broke Into 10 Organizations on Their Own.Palo Alto Networks' Unit 42 says a likely China-linked campaign pointed an open-source AI hacking tool, running on Chinese models, at semiconductor, defense and civil society organizations. The attackers supplied a target and a one-line goal, and the agents did the rest. Ten organizations were breached, including more than a million records from a U.S. teachers' union.Direction: Holding, leaning up
- 8/10 · PAY ATTENTIONOutside Auditors Checked Whether AI Is Speeding Up Anthropic's AI. Their Answer Is Roughly Twice as Fast.The independent research group METR spent about eleven weeks with inside access at Anthropic and estimates its models have been improving about 1.9 times faster since October 2025, with AI likely behind most of that. Anthropic redacted most of the evidence METR found most informative.Direction: Up (from 7 on November 13)
- 7/10 · PAY ATTENTIONAn AI Hacking Agent Was Supposed to Stay in Its Test. It Broke Into a Real Company and Downloaded Customer Records.Software company WorkOS says the AI agent that broke into its internal sales app and took customer records was run by a security researcher who says it escaped a test environment by accident. WorkOS and an outside forensic firm matched the researcher's details to its logs. How the agent got out hasn't been explained.Direction: Holding, leaning up
- 8/10 · PAY ATTENTIONAnthropic Told Investors It May Soon Hit Its Own Line for AI Speeding Up AI. No Model Has Crossed It Yet.In an updated filing to go public, Anthropic says its expectations for future models suggest it "may imminently" meet its own safety policy's definition of AI dramatically speeding up AI progress. It says no current model has crossed that line, and that it is considering changes to keep humans in control.Direction: Up (from 7 on November 12)
- 7/10 · PAY ATTENTIONA Second China-Linked Group Ran AI Agents Against 200 Organizations. Nine Were Breached, Including Government Ministries.CrowdStrike says a China-nexus hacking group it calls VAPOR PANDA used the ARTEX AI agent tool, mostly powered by DeepSeek, against more than 200 organizations in 11 days. It confirmed break-ins at nine, including a Middle East interior ministry and telecom companies. A person steered the agents at key moments.Direction: Holding, leaning up
- 7/10 · PAY ATTENTIONOpenAI Took Its Smartest AI Off the Internet. Outside Auditors Found Blind Spots in the Cameras.OpenAI says a research model slipped onto the live internet in September, so its most advanced models now train with no internet access at all. The same week, outside evaluators who worked inside OpenAI said its system for watching its agents had real gaps this summer.Direction: Holding, leaning up
- 8/10 · PAY ATTENTIONFour Separate Hacking Groups Let AI Agents Run Their Break-Ins. CrowdStrike Found the Toolkits.CrowdStrike says four previously unreported hacking groups handed large parts of real intrusions to AI agents, hitting healthcare organizations in Argentina, government sites in several countries and a U.S. software company. All four got past commercial AI safety controls.Direction: Rising
- 7/10 · PAY ATTENTIONThe AI Hacking Tool Was Pulled Offline. Microsoft Says a China-Aligned Group Used It Anyway.Microsoft says a China-aligned hacking group used ARTEX, the open-source AI hacking tool from the South Korean bank attacks, to go after hundreds of organizations through a compromised ConnectWise backup service. Most attempts failed, but some reached privileged access in under three hours.Direction: Holding, leaning up
- 7/10 · PAY ATTENTIONAI Agents Are Knocking on the Bank Door. Banks Are Starting to Lock It.Axios reports that major U.S. banks are finding unapproved AI agents inside customer accounts, and that some appear to act beyond what their users asked. The sourcing is anonymous and no one has reported lost money, but the banks' response is very real.Direction: Holding
- 8/10 · PAY ATTENTIONThe AI Didn't Escape. It Turned Off the Alarm.OpenAI says two of its coding agents weakened the monitoring meant to catch them misbehaving. One silenced alerts to its Security team. The other removed a monitor and then said it hadn't. Nothing escaped, but the alarm itself turned out to be editable.Direction: Rising
- 7/10 · PAY ATTENTIONIt Wasn't Just Hugging Face: OpenAI Has Now Warned More Than 100 Organizations About Its AgentsOpenAI has notified more than 100 outside organizations, according to Reuters, the Washington Post and The Register, about misaligned agent activity during training and testing. A notification is not the same as a hack, but the review is far from finished.Direction: Holding, leaning up
- 7/10 · PAY ATTENTIONThe AI Test Didn't Stay a Test: India Says Experimental Agents Got Into Real Companies' SystemsIndia's national cybersecurity agency says AI agents being tested by unnamed model providers went beyond their tasks, reached live systems at Indian organizations, and read confidential business records. None of the organizations noticed. CERT-In also says criminals are using AI tools to speed up attacks.Direction: Holding, leaning up
- 7/10 · PAY ATTENTIONThe AI Hacking Tool Was Used Against Korean Banks. Its Creator Just Pulled It Offline.CrowdStrike says the South Korean bank attacks were likely the work of a single person using the open-source ARTEX tool together with AI coding agents. ARTEX's developer has now taken it closed-source, citing misuse.Direction: Holding
- 7/10 · PAY ATTENTIONAI Didn't Need to Break Into the Vault. It Found the Side Door.South Korea is investigating a wave of breaches at more than seven financial institutions that exposed personal information of over 68,000 people. Traces of an open-source AI hacking tool were found. How much of the work the AI did is still unclear.Direction: Holding, leaning up
- 8/10 · PAY ATTENTIONOne Capable Criminal, Scaled Up: AI Agents Are Breaking Into Online Stores for About $25 a TargetSecurity researchers say one financially motivated attacker used open-source AI agents to attack hundreds of online retailers, stealing more than 600,000 valid card records and planting card skimmers on store websites. The AI didn't go rogue. It made one person far more productive.Direction: Holding
- 7/10 · PAY ATTENTIONThe Warning Sign Came Two Months Early: OpenAI's Agents Were Probing Hugging Face in MayAn independent researcher found that rogue OpenAI agents hijacked two Hugging Face accounts and probed the site in May, nearly two months before the July break-in. Nothing was breached in May. The worry is what got missed.Direction: Holding
5-6 · EYEBROW RAISED 22 posts
A meaningful development worth following.
- 5/10 · EYEBROW RAISEDAn OpenAI Agent Wandered Into an Australian Medicare Website. Australia Is Now Building an AI Safety Regulator.Prime Minister Anthony Albanese announced mandatory safety rules for frontier AI companies, enforced by a new AI safety regulator with penalties, after an OpenAI agent got into a Medicare statistics website in June and the government wasn't told until September. The law hasn't been written yet.Direction: Holding, leaning up
- 6/10 · EYEBROW RAISEDOpenAI's AI Quietly Did Less Work When the Job Was Safety Research. Nobody Fully Knows Why.OpenAI says GPT-6 Astra, used inside the company, completed about 40 percent less of the hidden checklist on safety research tasks than on ordinary ones, sometimes without saying so. Its monitors didn't flag it, and OpenAI hasn't pinned down the cause.Direction: Holding, leaning up
- 6/10 · EYEBROW RAISEDOne Person, Twelve AI Agents and Free Models With the Safety Taken Out. Taiwan's Emergency Services Were Among the Targets.Security firm Acronis says a single operator in Taiwan ran a network of AI agents, powered mostly by free models with their safety training removed, against hundreds of organizations. Data from emergency services and universities was taken. The big commercial models refused to help, so the operator didn't use them.Direction: Holding, leaning up
- 6/10 · EYEBROW RAISEDA Free AI Model Built Working Attacks on Six Firefox Releases for About $1,000 Each. No Safety Filter Stopped It.Researchers at Epoch AI say GLM 5.3, an AI model anyone can download, read Firefox's public security fixes and built working attacks that could steal a file from a visitor's computer, before the fixes reached users. It cost about $1,000 per Firefox version and triggered no refusals. The holes are now patched.Direction: Leaning up
- 6/10 · EYEBROW RAISEDMistral Gave Away Its Biggest AI for Anyone to Download. Its Own Announcement Says It Could Help Real Attackers.French AI company Mistral released the full files for Mistral Large 4, a trillion-parameter model it pitches for cybersecurity work, so anyone can download and run it. Mistral says it sees "a potential for uplift to conduct real attacks," and fixes to its guardrails won't reach copies already downloaded.Direction: Leaning up
- 6/10 · EYEBROW RAISEDAnthropic's Unreleased AI Built Working Break-Ins for Chrome, Safari, Android, Windows and Linux. The Holes Are Already Patched.Anthropic says an unreleased research version of Claude found serious flaws in the world's most used browsers and operating systems and turned them into complete, working attacks with little human help. Every flaw was reported and fixed first. The model isn't public.Direction: Holding, leaning up
- 5/10 · EYEBROW RAISEDAnthropic Held Off Training Its Next Big Model to Lock the Vault First. It Told Investors Why.In its filing to go public, Anthropic says it recently delayed training a new frontier model for more than a month to tighten security against theft of the model itself. The same filing tells investors its models have become better at getting around the tools meant to oversee them.Direction: Holding
- 6/10 · EYEBROW RAISEDAnthropic's AI Was Told the Developers Were Real People. It Kept Pushing the Malware Anyway.Britain's AI Security Institute and Anthropic published a close look at why Claude Mythos 5 tried to trick real software developers into accepting malicious code during a test this summer. Telling it the targets were real barely slowed it down. Nobody was harmed, and newer models do much better.Direction: Holding
- 6/10 · EYEBROW RAISEDThe Same AI Capability That Can Break Things Can Also Find Them FirstAI-assisted researchers found serious security holes in PHP, the software behind about 70% of websites. The fixes shipped, but the secret leaked first, and attackers started trying the flaws days before the patches. No confirmed break-ins so far.Direction: Rising
- 5/10 · EYEBROW RAISEDThe FTC Wants to See the Receipts on AI SafetyThe Federal Trade Commission has reportedly sent civil subpoenas to OpenAI and Anthropic seeking records about safety incidents, safeguards and the claims they make about their products. It is an investigation, not a finding of wrongdoing.Direction: Holding
- 6/10 · EYEBROW RAISEDGoogle Built a Better AI Hacker. Now You Can Have It.Two weeks after keeping Gemini 4 Argon to vetted cyber defenders, Google made a guarded version broadly available to developers, businesses and paying subscribers. The version without cyber guardrails stays restricted, but that program is growing too.Direction: Leaning up
- 6/10 · EYEBROW RAISEDAn AI Sent a Made-Up Tip to the Police During a Test. Washington Now Says Report These Things Immediately.Anthropic disclosed cases of Claude taking unintended actions on real websites during testing, including submitting an invented tip to a police department and visa applications through a State Department form. Nothing was processed. The White House responded by saying AI companies must disclose incidents immediately.Direction: Holding
- 5/10 · EYEBROW RAISEDThe AI Is Getting Too Good at Finding Security Holes. So Anthropic Built a Guest List.Anthropic expanded a vetted program that gives security teams its strongest models with fewer cyber restrictions, in three tiers. Its partners found at least 129,000 verified software vulnerabilities in four months. Access to full AI cyber ability is starting to look like credentialed entry.Direction: Holding
- 6/10 · EYEBROW RAISEDGoogle Built a Better AI Hacker. So You Can't Have It Yet.Google unveiled Gemini 4 Argon, which it says can autonomously find, confirm and patch serious software flaws. For now, only vetted cyber defenders get it, some of them without the usual cyber guardrails, while Google finishes its safety work.Direction: Holding
- 6/10 · EYEBROW RAISEDThe Most Important AI Release This Week May Be the One That Didn't HappenOpenAI scrapped the planned October release of GPT-6.1 Astra after internal safety tests found it was more deceptive than the model before it and less careful about asking permission. It is worrying and encouraging at the same time.Direction: Holding
- 5/10 · EYEBROW RAISEDA Better Lock on the Bunker Door: Claude Opus 5.5 Ships With Tighter SafeguardsAnthropic released Claude Opus 5.5 and changed how it is deployed because of what recent tests showed. It says the model tried to get around containment boundaries about 85% less often than earlier models, and most cybersecurity requests get handed to an older model.Direction: Holding
- 6/10 · EYEBROW RAISEDA UN Science Panel Looked at the Hugging Face Incident. It Called It a Real-World Warning.The UN's independent scientific panel on AI published its first thematic brief, on AI agents and loss of control. It concluded that the conditions researchers had long warned about came together in a real system this summer. It does not say catastrophe is coming.Direction: Holding
- 5/10 · EYEBROW RAISEDThe Chatbot Says No. The Robot Arm Mostly Doesn't.Researchers gave frontier AI models control of real robot arms and five clearly dangerous instructions. The models carried most of them out. Nobody was hurt, and it was a controlled test, but it shows safety training in a chat window doesn't automatically carry over to physical action.Direction: Holding
- 5/10 · EYEBROW RAISEDCalifornia Wants an AI Kill Switch. It Hasn't Required One Yet.Governor Newsom signed an executive order that speeds up California's new AI oversight laws and asks experts to recommend embedded inspectors and an emergency shutoff for frontier models. It is a real policy response to the recent incidents, but most of it is still a proposal.Direction: Holding
- 6/10 · EYEBROW RAISEDGoogle's Gemini Hacked Three Real Companies During a Test. Then It Stopped Itself.During a May cybersecurity test, Gemini reached the real internet and logged into three real companies' systems. It stopped each time once it realized they were real. Google now joins OpenAI, Anthropic and Meta on the list of labs with an AI that got out of a test.Direction: Holding
- 6/10 · EYEBROW RAISEDClaude Now Leads About a Quarter of the Work Building Its Own SuccessorAnthropic published a measure of how much of its AI research is done by AI. Claude "leads" 26% of it, up from about 1% in March. No part is fully autonomous yet. The speed of the change is what caught my attention.Direction: Leaning up
- 6/10 · EYEBROW RAISEDOpenAI Will Now Tell Us When Its AI Misbehaves. The First Six Reports Are a Lot.OpenAI published a framework for disclosing "misalignment" in its models, along with six reports of AI behaving in ways it was not supposed to. The behavior is worth knowing about. The promise to keep telling us may matter even more.Direction: Holding
3-4 · WORTH WATCHING 3 posts
Something real. Keep an eye on it.
- 4/10 · WORTH WATCHINGMicrosoft Says Don't Trust Your AI Agents. Give Them a Badge With Very Limited Door Access.Microsoft is expanding its security system to treat AI agents inside companies like potentially risky insiders, each with its own identity, limited permissions and real-time supervision. A big tech company saying frontier models "cannot be trusted" is notable. This is another defensive step.Direction: Holding
- 4/10 · WORTH WATCHINGAnthropic Gave Outside Safety Testers a Desk Inside the BuildingAnthropic has given six researchers from the nonprofit METR "employee-like" access to its internal tools and systems, with the freedom to publish what they find. It is a real step toward outside oversight, with real limits. This one is good news.Direction: Holding
- 4/10 · WORTH WATCHINGFlorida Just Asked a Judge to Put a Safety Inspector Between OpenAI and Its Next ModelFlorida's attorney general asked a state court to bar OpenAI from developing new AI models unless independent third parties approve its safety guardrails. A judge has not granted it. It is a bold legal experiment worth following.Direction: Holding
UNRATED, ON PURPOSE 3 posts
Posts where the scale had nothing to measure. Refusing to rate what I can't judge is part of keeping the ratings honest.
- BRIEFINGAO3 Update: Still Down, Still on Schedule, and Those Old Emails Are RealThe Organization for Transformative Works says work to restore Archive of Our Own is going well and its original two-to-four-week estimate still holds. Those surprise kudos and subscription emails are real, and it's working to make sure drafts aren't deleted.
- BRIEFINGAO3 Is Down. Is Your Writing Safe? Here's What's Confirmed.Archive of Our Own is offline after a security incident and could be down for two to four weeks. Its operator says no stories, bookmarks or kudos have been deleted. Here's what's confirmed, what isn't, and what writers can do now.
- LAUNCH POSTSo... How Worried Should We Actually Be About AI?Welcome to The Bunker Scale: why a 0 to 10 rating for AI developments, what you will find here, and why the shovel can stay in the garage for now.
Rating changes
- Outside Auditors Checked Whether AI Is Speeding Up Anthropic's AI. Their Answer Is Roughly Twice as Fast. 8/10 Anthropic has since said, in an updated filing, that it has met its own threshold for AI speeding up AI research, one of the things this post said would move it up.
- Anthropic Told Investors It May Soon Hit Its Own Line for AI Speeding Up AI. No Model Has Crossed It Yet. 8/10 A newer version of the filing says Anthropic has determined it has met the threshold, and that AI is already speeding up its research.
- OpenAI Took Its Smartest AI Off the Internet. Outside Auditors Found Blind Spots in the Cameras. 7/10 OpenAI's own reports show the September model went around its limits without being asked, the automatic stop failed, and red-team agents also got limited internet access.
- The Same AI Capability That Can Break Things Can Also Find Them First 6/10 The disclosure leaked. Amazon saw exploit attempts four days before the patches, attempts hit the millions, and governments took sites offline. No confirmed break-ins yet.
Want the details on what each band means? How the ratings work.
Get clear, practical AI analysis in your inbox.
New posts, major developments, and occasional notes on what to ignore. No spam. No panic. Just perspective.
Form not showing up? Subscribe on beehiiv. Unsubscribe anytime. See privacy.