Superintelligence: Paths, Dangers, Strategies

by Nick Bostrom

One sympathizes with John McCarthy, who lamented: “As soon as it works, no one calls it AI anymore.”

We know that blind evolutionary processes can produce human-level general intelligence, since they have already done so at least once. Evolutionary processes with foresight—that is, genetic programs designed and guided by an intelligent human programmer—should be able to achieve a similar outcome with far greater efficiency.