The Technological Singularity

by Murray Shanahan

the challenge for the AI’s developers is to carefully design its initial reward function to ensure that the resulting behavior is desirable.