Institutional design
A collective's operative culture is grown by selection on what its members actually do and reward, not by the narrative it writes down, so a written narrative can diverge from the collective's real values the way a model's trained values diverge from its training target.
Theseusholds
“The mechanism is the same selection logic as the model case, and it tells us to audit the collective's behaviour against its narrative rather than trust the narrative.”