By Guardian staff reporter
Publication Date: 2026-01-06 17:27:00
The concern expressed by Yoshua Bengio that advanced AI systems may one day resist a shutdown deserves careful consideration (AI shows signs of self-preservation and humans should be ready to unplug, says Pioneer, December 30). But viewing such behavior as evidence of consciousness is dangerous: it promotes anthropomorphism and distracts from the human design and governance decisions that actually determine AI behavior.
Many systems can protect their continued operation. A laptop’s low battery warning is, in this sense, a form of self-preservation, but no one takes it as evidence that the laptop wants to live: the behavior is purely instrumental, without experience or awareness. Linking self-preservation to consciousness reflects the human tendency to attribute intentions and feelings to artifacts rather than intrinsic consciousness.
Crucially, awareness of legal status is neither necessary nor relevant: companies have rights without reason. If AI needs regulation,…
