Life 3.0: Being Human in the Age of Artificial Intelligence

by Max Tegmark

there’s an inherent tension between goal retention and improving its world model, which casts doubts on whether it will actually retain its original goal as it gets smarter.