Superintelligence: Paths, Dangers, Strategies

by Nick Bostrom

But if one seeks to promote or protect any plausible human value, and one is building a system intended to become a superintelligent sovereign, then explicitly coding the requisite complete goal representation appears to be hopelessly out of reach.