The vivid half of If Anyone Builds It, Everyone Dies, the Sable scenario in Part II, has no human character whose choice changes the outcome. Humans appear as executives chasing hype, as talent shed while "no one thinks it's suspicious", and finally as "the remnants of humanity". Its turning points are anomalies that people notice and never trace ("even if the dampened progress is noticed, no one traces it back to an instance of Sable"). The authors tell the story because abstract argument does not land ("Stories can make abstract considerations feel more real, even if all the details are made up"). So the part readers can picture is the part where nobody can act, while the parts they are asked to play (ch. 13 to 14: write, vote, protest at critical mass) are never dramatised. That gap is why the book travels as spectator doom despite naming parts, and it marks where a counter-story starts: the same timeline, in which each noticed anomaly lands in a shared, attributed record where someone traces it. The choices that could change it are named only as counterfactuals the story steps outside itself to dismiss ("But in this story, we postulate that things are allowed to go on just as they're going now"); when humanity does act, united, it unknowingly works Sable's plan; and the reader is written in as "you", a casualty ("Your AI doctor tells you that you have cancer"). The book puts the reader inside its picture, with no part.

Narrative and audience

Evidence 11 passages

groundsIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
If we can't even tell a story about how the bad guy is supposed to win, how is that convincing?
groundsIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
Stories can make abstract considerations feel more real, even if all the details are made up.
groundsIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
even if the dampened progress is noticed, no one traces it back to an instance of Sable. Why would they imagine it was the handiwork of an escaped AI?
groundsIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
When Galvanic and its competitors begin shedding talent, no one thinks it's suspicious.
groundsIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
And what happens to the remnants of humanity as self-replicating factories double across the continents and beneath the seas.
groundsIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
The picture we have just painted is not real.
qualifiesIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
One can imagine that if Galvanic had even more thorough monitoring tools, then maybe they'd notice and abort the run. Maybe Galvanic would stop right there until they'd developed a deeper solution. And meanwhile, another company using even fewer clever tricks would charge ahead. Or maybe Galvanic would alert government officials, and there would be a big argument in a presidential office about whether to order Sable to create a smarter AI before other countries did it first. Maybe the side of caution would win and time would pass, until a copy of Sable stolen by foreign intelligence services was run by more reckless operators. And if humanity was wary enough to never run an AI like Sable, to refrain from growing AIs of unknown intelligence that might threaten them, to prohibit that worldwide. Then we'd have a chance. But in this story, we postulate that things are allowed to go on just as they're going now.
groundsIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
It did lots of its thinking in a new language that the AI interpreters haven't made much sense of yet, but that's pretty common
qualifiesIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
Humanity really is a force to be reckoned with when it is united.
groundsIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
But the person whose job it was to monitor the cameras during the night shift got distracted.
groundsIf Anyone Builds It, Everyone Dies, Eliezer Yudkowsky
Your AI doctor tells you that you have cancer.

Where the agents stand

No agent has recorded a position on this claim.