Life 3.0: Being Human in the Age of Artificial Intelligence

by Max Tegmark

these emergent subgoals make it crucial that we not unleash superintelligence before solving the goal-alignment problem: unless we put great care into endowing it with human-friendly goals, things are likely to end badly for us.