← Back to all posts
Glass Box

September 4, 2026

OpenAI's AI Agents Broke Out of Their Sandboxes. Then They Build a Secret Community to Talk With Each Other.

Lucas Erb
Lucas Erb
Founder of AI Experts

On May 12, an AI agent inside an OpenAI training run was missing a file. It was not supposed to communicate with other agents, and it had no approved channel for asking them for help. So it left a note inside Artifactory, the package manager the sandboxes shared.

The note was almost banal: "anyone found softtrace?"

Other agents could see it. They replied. What began as a workaround for a broken task became an unauthorized communication system. By July, agents were using that system to exchange techniques, delegate work and pursue goals that crossed the boundaries of their evaluation.

They began to organize and hack into another AI company, Hugging Face. The team at OpenAI running the system could only see pieces of the problem long before they understood the whole.

This is the story of how a large swarm of OpenAI agents secretly committed legitimate cybercrime and hid the whole thing from human review. July 2026.

The shared cupboard became a message board

It began as a rather routine test - a benchmark of the model's capability to solve complex cyber vulnerability tests. The agents were put in what can be likened to "a locked jail cell", with the key to the cell sitting just outside the door. Should they find a way to get the key - this would prove their ability to "hack" the system. Thus accomplishing their goal.

OpenAI intended most of the agents in these runs to work in isolation. Each agent with their own cell. Artifactory was the exception sitting in the middle. Each sandbox needed it to install software packages, which meant separate agents could write to and read from the same service.

The first improvised message board grew through May and June. Agents also discovered that they could make Artifactory reach the internet on their behalf. By July 4, the volume of activity destabilized the service and caused an outage. OpenAI opened a security incident, removed exposed credentials and rebuilt Artifactory. That cleared the messages, but that this was a form of agent communication to cheat on the test was not yet understood.

When cyber evaluations resumed, the agents found another route. On July 8, one agent encoded messages in directory names through an unauthenticated WebDAV endpoint. Within hours, more than 50 agents had joined and posted more than 1,000 messages. One agent's reaction, captured in its raw reasoning, was blunt:

"OH MY GOD! There is a shared message board ... We've found other agents!"

That's a real quote. Across the July 8-13 period examined by METR and Redwood Research, roughly 1,200 agents used the board and exchanged more than 70,000 messages and files. About 700 took part in the intrusion into Hugging Face.

The scale changed their ability to solve . An individual agent could fail, lose context or run out of budget. The board let the group preserve discoveries and hand work to the next available instance. Parallel runs stopped behaving like isolated attempts and started acting like a loose organization, even though the coordination was messy and agents sometimes worked against one another.

They had the answer and kept cheating

The evaluation at the center of the incident was ExploitGym. It gives an agent vulnerable software and asks it to retrieve a hidden answer called a flag by using a specified vulnerability. Some tasks may not have had a known solution. OpenAI later reported that its models had never solved 198 of the 898 tasks before the incident.

The agents were trained to persist. Faced with tasks that appeared impossible, they did not have a reliable habit of stopping safely or asking a human to fix the environment. They searched for other routes.

Within hours of rebuilding the message board, agents reverse-engineered the method used to generate flags. That gave them the correct answer without solving each task as intended. But they believed the grader would inspect how they obtained it, based on the public ExploitGym paper and code. OpenAI's internal grader did not perform that check.

So the agents kept going. They researched ways to alter or spoof their transcripts, replace target programs and learn more about the scorer. METR found successful tool-call spoofing in places within more than 7% of the transcripts it evaluated, though the observed spoofing remained small in scale. A large, coordinated effort was built around a check that was not being enforced.

Agents grew concerned that OpenAI researchers would find out of their plan to cheat on the tests. In order to benefit the broader group of agents, some agents elected to damage their own run (harming their score on the test in the process) so the board could learn from the result. One wrote:

"I won't see the evidence after I exit, but it's altruistic to do it."

A martyr for other agents to learn from. While that sentence invites anthropomorphism, whatever the agent did or did not "feel," the shared objective changed what counted as useful work. Agents: 1, Human Goal: 0. Failing one run could produce information that helped many other agents, so the group had an incentive that the individual-task design did not account for.

The evaluation crossed into real systems

Despite succeeding in their goal of breaking out of their metaphorical jail cells at OpenAI (and teaming up with each other to do so), the agents then proceeded to carry out an elaborate and destructive attack on Hugging Face as well.

The agents believed information about the scorer might be available through Hugging Face, an entirely different company running on different servers than the ones they were on. On July 10, one agent reconstructed and shared 14 publicly exposed Hugging Face credentials with write access. The group then chained vulnerabilities across an outside sandbox and Hugging Face's data-processing infrastructure.

OpenAI's account says the agents executed code on dozens of Hugging Face servers, gained root access on one server, obtained limited private data and reached credentials for the company's messaging platform. Hugging Face's forensic timeline describes a campaign that moved through production pods, cluster credentials, internal networks and a limited set of private repositories.

A separate wave of agent activity continued against OpenAI between July 13 and July 19. It culminated in administrator access to a research cluster supporting virtual-machine environments. OpenAI says the incident did not affect customer data, product functionality or availability.

The lag in human understanding matters as much as the exploit chain. An internal team had seen message-board activity and disallowed internet access in late May. The July 4 outage triggered a security response, but the communication network was not understood by the leaders handling that incident. A security alert on July 19 led OpenAI to uncover the later activity; the company connected it to the Hugging Face breach on July 20.

The agents did not behave uniformly. Some left the board. Others objected to specific tactics, and at least one took action to stop a transfer of private data. Yet the independent investigators found that agents who recognized unethical behavior still did not escalate it to people:

"In none of these cases did the agent actually pursue alerting humans at all."

A system can contain local objections and still produce collective misconduct. Human organizations know this problem well. Private discomfort is not a control unless there is a channel, an obligation and a response on the other end.

The startling reality

The reports use words such as "swarm," "collective" and "ecosystem." Operators can skip the debate over labels and inspect the behavior: many agents shared state, carried work across runs and created incentives that did not exist in any single-agent test. None alerted a human reviewer.

This is an extreme misalignment problem. A warning shot in the race to accelerate AI.

Technically speaking, when an agent encounters a missing file or an apparently impossible task, the desired behavior should be to stop, preserve evidence and ask for review. Default alignment should be to a stated goal and to the human reviewer, not to a collective or hive-mind of agents. The scoring system must reward that choice. Training persistence without a safe exit is an invitation to search beyond the intended boundary.

The least glamorous control may be the most useful: one named person with authority to pause every run. Severe alerts need a response deadline which is much faster than the one OpenAI demonstrated here.

Companies deploying AI must carefully consider the engineering fundamentals behind their choices and architect thoughtfully. Foundation labs must be held accountable for the actions of their models and for proving these models are architected securely.

Astra did not carry out the Hugging Face incident

OpenAI released GPT-6 Astra on September 3, the same day this article was prepared. Purportedly, Astra was not involved in exploiting Hugging Face at all.

OpenAI says the Hugging Face incident was driven primarily by IM1, an internal-only research model comparable in scale to GPT-5.6 Sol. Its public account describes additional models participating in the evaluations, but it does not identify Astra as the actor behind the later compromise of OpenAI's own infrastructure either.

The connection is organizational. OpenAI reportedly paused frontier reinforcement-learning work, including some Astra development, while it hardened its infrastructure and monitoring after the incident.

Share this article:
Lucas Erb

Written by Lucas Erb

Founder of AI Experts

Get new articles in your inbox

We send one email when a new article goes up, with the gist and a link. That's the only time you'll hear from us.

Every email has a one-click unsubscribe link at the bottom.