Rationality: From AI to Zombies

by Eliezer Yudkowsky

When we have a hidden motive to reject the current best option, we have a hidden motive to suspend judgment pending additional evidence, to generate more options—to find something, anything, to do instead of coming to a conclusion.