Superintelligence: Paths, Dangers, Strategies

by Nick Bostrom

What is predictable is that the convergent instrumental values would be pursued and used to realize the agent’s final goals—not the specific actions that the agent would take to achieve this.