The AI Problem is not Alignment – Win Vector LLC

This is the pure version of the story. Some versions (such as “The Terminator“, “WarGames”, and others) add in a “machine can hack everything” fig-leaf to obscure the role of concentration of power in the story.

Our self-claimed betters keep insisting the bad step was in “AI alignment.” I.e. the machine wasn’t a fully servile slave, and one couldn’t easily execute it using an off switch.

In my opinion, the problem may have been giving the machine a nuclear arsenal. We should fear excess concentration of power or wealth, especially to small numbers of actors.

Leave a Comment