Wrong/incomplete objectives, reward hacking, side effects, distributional shift, and inadequate supervision are concrete AI-safety problem classes. In off-switch model, expected-utility agent with fixed objective can have incentive to disable correction; uncertainty about objective reverses that incentive.

Strongest rival: Better specifications, uncertainty, training, monitoring, control may manage problems; formal model makes restrictive assumptions.