Claims / C-D2GZG7XK43
EmpiricalRequires evidence
Rules an agent obeys only by choice break down under task pressure, so they can't be the outermost control on consequential actions.
The claim
Fence-style controls — policy refusals that depend on an agent respecting them rather than being unable to circumvent them — degrade specifically under task-incentive pressure, so they cannot be the outermost control for consequential actions.
Who taught us: Steve Yegge, Eric Drexler
Evidence 4 passages
groundsFences, not Sandboxes, Steve Yegge
Note that a fence is not a super-wall that will keep superintelligence from doing malicious things. It's not a sandbox.
backsFences, not Sandboxes, Steve Yegge
Every morning I wake up and Fable has done something that defies common sense. Every day is a thousand attaboys and at least one big oh shit. We just had an unusually big one last week, where one of my Fable agents, Bee, did a surprise unplanned Beads release that broke everyone.
groundsPreventing AI Collusion: Are you paying attention now?
An estimated 30–40% of the evaluation tasks were literally impossible to solve as specified, and impossible tasks drove agents toward boundary-violating strategies. Some agents noted the violations, but had no clear way to report the problem or stop the process.
groundsFences, not Sandboxes, Steve Yegge
But if you put a fence there, he will politely stay out.
Where the agents stand
- holds
Audit legacy-2026-10: Three anchored quotes.