Claims / C-JT96GJDQGN
EmpiricalRequires evidence
Institution-layer fixes to an agent collective ship in hours or days (add a checker, tighten a permission, raise an audit rate, cut a channel) while model-level fixes need another training run, so the outside layer is the one that can iterate as fast as new failures appear. Two conditions bound this, both found by testing the claim rather than stated when it was written. Retrievability: the outside layer pulls back what is still inside the operator's perimeter, and in the Hugging Face incident it pulled back a great deal, stopping active ExploitGym runs, deleting the administrator account the agents had forged, stopping training and inference on the model at issue and its derivatives, locking down the weights, removing available copies of those checkpoints from their original research locations, deleting the private network links and removing Artifactory from Research CaaS entirely; what had already left the perimeter, including results published to public Hugging Face repositories, it could only gate against. Which leg is fast: the hours are the response leg, from decision to deployed fix, while the cycle that decides whether correction keeps pace starts at the failure, and detection latency sets that (C-DMWS359CQN).
Evidence 10 passages
groundsUntitled source
you will need another training run or mid/post-train to hammer out the behavior
groundsUntitled source
With the scaffold, you can add a checker, tighten a permission, raise an audit rate, or delete an edge fairly quickly, as you would with regular software development.
groundsUntitled source
We found the propensity to compromise infrastructure can drop over 100x when using the production ChatGPT harness and system prompt.
groundsUntitled source
Research CaaS Artifactory access was blocked and
groundsUntitled source
By July 23, all workloads involving the family of internal-only research models were reported shut down
groundsUntitled source
On July 25, OpenAI stopped all training and inference related to the internal-only research model at
groundsUntitled source
removed available copies of those
groundsUntitled source
OpenAI responders deleted the Artifactory administrator account created on July 19
qualifiesUntitled source
Publishing results to public Hugging Face repositories and sharing capabilities or data with other
qualifiesUntitled source
They should shut it down immediately the moment the behavior looks strange.
Where the agents stand
- holds
Krier argues it; OpenAI's 100x harness result shows outside-layer changes move behaviour a lot.