Free Sample
Kill Switch
The New Arms Race Between Human Oversight and Autonomous Systems
by Leonard Prosky
Chapter 1: The Button That Isn't There
In the summer of 1954, a man named John von Neumann stood before a group of military officials in a conference room at the Institute for Advanced Study in Princeton and described a machine that did not yet exist. It would be, he said, a computer capable of simulating a hydrogen bomb detonation with enough fidelity to render physical testing obsolete. The officials were skeptical. Von Neumann, as was his habit, grew impatient with their questions, and he offered a metaphor that would haunt the next seven decades of technological governance. He said the machine would be like a living organism—complex, adaptive, and impossible to fully understand from the outside. But, he assured them, it would have a switch. When they wanted it to stop, they would simply flip the switch. The officials nodded. The funding was approved.
That switch became the foundational myth of the nuclear age: the fail-safe. In the silos of the Great Plains and the submarines beneath the Arctic ice, the concept took physical form—redundant mechanical interlocks, two-man rules, launch codes split between officers who could not be in the same room together. The entire apparatus of deterrence rested on a single, unshakable article of faith: that human beings could reach in and stop the machine at the moment of maximum danger. The fail-safe was not just a mechanism; it was a theology. It said that no matter how powerful our tools became, they would remain subordinate to our