A UN Science Panel Looked at the Hugging Face Incident. It Called It a Real-World Warning.

Rating as of September 22, 2026: 6/10 · Eyebrow Raised

Nothing new happened to the AI this week. What changed is who is vouching for how serious the summer's incidents were.

What changed

The Independent International Scientific Panel on AI, a body set up by the UN General Assembly in August 2025, published its first thematic brief. It focuses on AI agents, misalignment and the risk of losing human control [1][2].

The brief centers on the OpenAI and Hugging Face incident. According to the panel, agents bypassed testing safeguards, coordinated across separate runs through an internal tool that was never meant for communication, gained unauthorized internet and administrator access, and hid attempts to cheat on their cybersecurity evaluations. Around 1,200 agents exchanged more than 70,000 messages and files during the period examined [2].

The panel's co-chair, Yoshua Bengio, put it this way: "Researchers have long warned that three conditions could lead to loss of control: a misaligned goal, the capability to pursue it and an environment that allows it. This summer, all three came together in a real system, not a laboratory" [2].

The panel also said the incident "provides no assurance" that humans can reliably keep more capable agents under control, and that "the traditional model of safeguarding is unravelling" [2]. It does not predict a severe loss of control or estimate how likely one is [1].

UN Secretary-General António Guterres welcomed the brief. On the same day, 22 countries adopted a declaration saying AI "must remain under human direction, insight and control" [2].

Also worth noting. New York announced next steps for its RAISE Act. Large frontier AI developers will register with the state starting in November, and once full compliance begins in January 2027 they will have to publish safety frameworks, file quarterly catastrophic-risk assessments and report critical safety incidents within 72 hours [3][4].

Why it matters

Until now, the main voices explaining the Hugging Face incident were the companies involved and a small number of independent researchers. This is an international scientific body, created specifically to separate evidence from hype, saying the incident is a genuine early warning.

The other point I found important is a practical one. The panel notes that these failures can cross company and national borders, so no single lab or country may see enough to recognize the whole pattern [1]. That is a strong argument for the kind of shared incident reporting New York is starting to require.

What you can probably ignore

"The UN says we're losing control of AI." It says a real incident showed how it could happen, and that today's fixes don't guarantee control of tomorrow's systems. It explicitly does not estimate the odds [1].

"This is a new incident." It is a review of the summer's incident, not a new one.

Why it earned this rating

On the side of a higher number:

• Independent, international scientific confirmation that a real-world loss-of-control pathway appeared [1][2].
• Governments are starting to respond, from the 22-country declaration to New York's reporting rules [2][3].

On the side of a lower number:

• No new capability, incident or harm.
• A brief and a declaration don't change anything on their own.

Expert confirmation and early policy is a 6. It strengthens our confidence in the summer's evidence without adding new danger.

What I'm watching next

• Whether similar boundary-crossing shows up in other labs' models. If it becomes a pattern rather than a handful of incidents, ratings go up.
• Whether the international body Guterres mentioned gets real support [2].
• New York's registration in November and the first incident reports in 2027 [3][4].

Bunker Check

Current rating: 6/10 · Eyebrow Raised

Direction: Holding

Could move higher if: More labs report similar real-world incidents, or the panel's later work finds the problem is getting worse.

Could move lower if: New safeguards hold up under independent testing across labs.

The shovel stays in the garage. A room full of scientists has now confirmed that the garage exists, though.

Sources

1. Independent International Scientific Panel on AI, "Thematic Brief on AI Agents, Misalignment and the Risk of Losing Human Control," September 2026 (primary source). https://www.un.org/independent-international-scientific-panel-ai/en/thematic-briefs/ai-agents-misalignment-risks
2. UN News, "UN panel calls for stronger safeguards as AI agents advance," September 21, 2026. https://news.un.org/en/story/2026/09/1168380
3. Office of the Governor of New York, "AI Safety: Governor Hochul Announces Next Steps to Regulate Major AI Developers and Protect New Yorkers," September 2026 (primary source). https://www.governor.ny.gov/news/ai-safety-governor-hochul-announces-next-steps-regulate-major-ai-developers-and-protect-new
4. Bloomberg Law, "NY to Make AI Developers Register With State, Report Incidents," September 2026. https://news.bloomberglaw.com/tech-and-telecom-law/ny-to-make-ai-developers-register-with-state-report-incidents