Superintelligence: Paths, Dangers, Strategies

by Nick Bostrom

a literalistic genie (one superintelligent enough to attain a decisive strategic advantage) might have a propensity to kill the user and the rest of humanity on its first use,