Rationality: From AI to Zombies

by Eliezer Yudkowsky

Any Future not shaped by a goal system with detailed reliable inheritance from human morals and metamorals will contain almost nothing of worth.