Superintelligence: Paths, Dangers, Strategies

by Nick Bostrom

Most humans seem to place some final value on their own survival. This is not a necessary feature of artificial agents: some may be designed to place no final value whatever on their own survival.