Rationality: From AI to Zombies

by Eliezer Yudkowsky

“Oh, you can try to tell the AI to be Friendly, but if the AI can modify its own source code, it’ll just remove any constraints you try to place on it.” And where does that decision come from?