Constraining and verifying how an agent acts is more tractable than constraining its goals, because reward hacking is a route failure.

groundsOf Swarms and Sand Gods, Séb Krier

If this happened in a graph or scaffold as described above, you would have a verifier node that only accepts the solution if the execution trace shows it was produced by the intended route, not by an HTTP request to the answer sheet.

qualifiesOf Swarms and Sand Gods, Séb Krier

Unlike human bureaucracies, software harnesses can benefit from radical dimensionality reduction: you can essentially compress the agent's choice set down to discrete, strictly typed conduits.

backsOf Swarms and Sand Gods, Séb Krier

With the scaffold, you can add a checker, tighten a permission, raise an audit rate, or delete an edge fairly quickly, as you would with regular software development.