The Undoing Project: A Friendship That Changed Our Minds

by Michael Lewis

What he did was teach the army interviewers—young women, mainly—how to put a list of questions to each recruit to minimize the halo effect. He told them to pose very specific questions, designed to determine not how a person thought of himself but how the person had actually behaved. The questions were not just fact-seeking but designed to disguise the facts being sought. And at the end of each section, before moving on to the next, the interviewer was to assign a rating from 1 to 5 that corresponded with choices ranging from “never displays this kind of behavior” to “always displays this kind of behavior.” So, for example, when evaluating a recruit’s sociability, they’d give a 5 to a person who “forms close social relationships and identifies completely with the whole group” and a 1 to “a person who was “completely isolated.” Even Danny could see that there were all kinds of problems with his methods, but he didn’t have the time to worry too much about them. For instance, he briefly agonized over how to define a 3—was it someone who was extremely sociable on occasion, or someone who was moderately sociable all the time? Both, he basically decided. The big thing was that the judge was to keep her private opinions to herself. The question was not “What do I think of him?” but “What has he done?” The judgment of who went where in the Israeli army was to be made by Danny’s algorithm. “The interviewers hated it,” he recalled. “I had a mutiny on my hands. I still remember one o...