Superintelligence: Paths, Dangers, Strategies

by Nick Bostrom

“AI has by now succeeded in doing essentially everything that requires ‘thinking’ but has failed to do most of what people and animals do ‘without thinking’—that, somehow, is much harder!”60 Analyzing visual scenes, recognizing objects, or controlling a robot’s behavior as it interacts with a natural environment has proved challenging.

McCarthy’s dictum that when something works it is no longer called AI.

von Neumann probes.