Noise: A Flaw in Human Judgment
Rate it:
Open Preview
Read between July 31 - August 28, 2024
66%
Flag icon
random interview
66%
Flag icon
not a single interviewer realized that the candidates were giving random answers.
66%
Flag icon
ability to create coherence.
66%
Flag icon
we are capable of finding logic in perfectly meaningless answers.
66%
Flag icon
our interpretation of facts is colored by prior attitudes.
66%
Flag icon
we tend to give too much weight to the interview and too little to other data that may be more predictive, such as test scores.
66%
Flag icon
interviews are not the only source of information about candidates—
66%
Flag icon
should the inputs be combined using judgment (a clinical aggregation) or a formula (a mechanical
66%
Flag icon
aggregation)?
66%
Flag icon
mechanical approach i...
This highlight has been truncated due to consecutive passage length restrictions.
66%
Flag icon
overwhelming majority of HR professionals favor clinical aggregation. This practice adds yet another source of noise to an already-noisy process.
66%
Flag icon
aggregation.
66%
Flag icon
aggregation works—but only if the judgments are independent.
66%
Flag icon
structuring complex judgments.
66%
Flag icon
defined by three principles: decomposition, independence, and delayed holistic judgment.
66%
Flag icon
decomposition, breaks down the decision into components, or mediating assessments.
66%
Flag icon
acts as a road map to specify what data is needed.
66%
Flag icon
filters out irrelevant information.
66%
Flag icon
defining the key assessments gets difficult for unusual or senior positions,
66%
Flag icon
many interviewers use bloated job descriptions produced by consensus and compromise.
67%
Flag icon
offer no way to calibrate the characteristics or make trade-offs among them.
67%
Flag icon
independence,
67%
Flag icon
structured behavioral interviews.
67%
Flag icon
shared scale
67%
Flag icon
helps reduce noise in judgments.
67%
Flag icon
structured interviews are far more predictive of future performance than are traditional, unstructured
67%
Flag icon
ones.
67%
Flag icon
Research has shown that work sample tests are among the best predictors of on-the-job performance.
67%
Flag icon
delayed holistic judgment,
67%
Flag icon
do not exclude intuition, but delay it.
67%
Flag icon
mechanical combination of data outperforms a clinical one,
67%
Flag icon
not mechanical.
67%
Flag icon
three principles—
67%
Flag icon
do not necessarily provide a template for all organizations trying to improve their selection processes.
67%
Flag icon
formalized an evaluation structure (the list of personality and competence dimensions that had to be evaluated).
67%
Flag icon
structured judgment methods are also less costly—because few things are as costly as face time.
67%
Flag icon
“the persistence of an illusion.”
67%
Flag icon
recruiters and candidates severely underestimate the noise in hiring judgments.
67%
Flag icon
traditional, informal interviews,
67%
Flag icon
irresistible, intuitive feeling of understanding the candidate
67%
Flag icon
We must learn to distrust tha...
This highlight has been truncated due to consecutive passage length restrictions.
67%
Flag icon
must add structure to our interviews and, more broadly, to our selection processes.
67%
Flag icon
make sure we evaluate the candidates independently on each of these dimensions.”
67%
Flag icon
mediating assessments protocol.
67%
Flag icon
decision hygiene strategies
67%
Flag icon
The protocol can be applied broadly and whenever the evaluation of a plan or an option requires considering an...
This highlight has been truncated due to consecutive passage length restrictions.
67%
Flag icon
stylized example that is a composite of several real cases: a fictitious
67%
Flag icon
differences are significant, but subtle—
68%
Flag icon
vast amount of research shows that structure in interviews leads to much higher accuracy—unstructured interviews as we used to practice them don’t even come close.
68%
Flag icon
options are like candidates.
1 22 26