The Tyranny of Metrics
Rate it:
Started reading March 18, 2019
38%
Flag icon
Not everything that
38%
Flag icon
can be measured can be improved—at least, not by measurement.
38%
Flag icon
Nowhere are metrics in greater vogue than in the field of medicine.
39%
Flag icon
the United States was number
39%
Flag icon
1 in terms of healthcare spending per capita
40%
Flag icon
Perhaps the most popular trend in American health policy is the promotion of performance metrics, accountability, and transparency.
41%
Flag icon
successful uses of metrics in medicine is the use of performance measures to reduce hospital-induced infections acquired from “central lines.”
41%
Flag icon
The Cleveland Clinic, Geisinger, and the Keystone project are frequently cited as proof of the efficacy of measuring performance, and with reason.
43%
Flag icon
The argument for accountability and transparency is based on the premise that the public release of metrics of success and failure will influence the behavior of patients, professionals, and organizations.
43%
Flag icon
The populations upon which medical research is based differ from the real populations that doctors and hospitals treat.
Violeta
Esto recuerdo haberlo mencionado en la clase pasada, para la realización de los estudios clínicos los pacientes son contactados al compartir ciertas características definidas por los investigadores. A menudo, la realidad dista mucho de lo que se analiza.
43%
Flag icon
such studies deliberately exclude patients with multiple medical problems.
Violeta
es un problema de los estudios clínicos.
43%
Flag icon
That might explain why simply following the recommended procedures does not necessarily lead to improved outcomes.
45%
Flag icon
“case selection bias”
45%
Flag icon
“Pay for performance” reduces intrinsic motivation.
47%
Flag icon
performance metrics may end up exacerbating inequalities in the distribution
Violeta
este punto es interesante de analizar. Pone en riesgo la equidad.
47%
Flag icon
of resources—
47%
Flag icon
The use of metrics to reward performance, either through monetary or reputational rewards, is much more problematic.
49%
Flag icon
counterinsurgency (COIN) campaigns, most recently in Iraq and Afghanistan.
50%
Flag icon
Interpretation of indicators is critically important, and requires informed expert judgment.
50%
Flag icon
interpretation is a qualitative activity
57%
Flag icon
distorting the information system of the organization.
57%
Flag icon
Performance indicators can certainly aid, but not replace, the key functions of management: thinking ahead, judging, and deciding.
59%
Flag icon
And it is characteristic of our culture that we tend to assume that performance and transparency rise and fall together.
59%
Flag icon
In interpersonal relations, even the most intimate ones, success depends on a degree of ambiguity and opacity,
60%
Flag icon
This strategy entails negotiation, trading off some interests against others in an attempt to attain a compromise that will be tolerable to a number of interests, though rarely entirely satisfactory to any one of them.
60%
Flag icon
Outputs include data that the government produces on social and economic trends, as well as the results of government actions, such as regulatory rules.
60%
Flag icon
Inputs, by contrast, are the discussions that go into government decision-making: discussions between policymakers and civil servants.
60%
Flag icon
Making internal deliberations open to public disclosure—that is, transparent—is counterproductive, Sunstein argues, since if government officials know that all of their ideas and positions may be made public, it inhibits openness, candor, and trust in communications.
60%
Flag icon
Transparency is also a hazard in diplomacy, and is fatal to the gathering of intelligence.
62%
Flag icon
The result is that the metric means comes to replace the organizational ends that those means ought to serve.
62%
Flag icon
advancing short-term goals at the expense of long-range considerations.
62%
Flag icon
Costs in employee time.
62%
Flag icon
Diminishing utility.
62%
Flag icon
Rule cascades.
62%
Flag icon
Rewarding luck.
62%
Flag icon
Discouraging risk-taking.
63%
Flag icon
Discouraging innovation.
63%
Flag icon
Discouraging cooperation and common purpose.
63%
Flag icon
Degradation of work.
63%
Flag icon
Costs to productivity.
64%
Flag icon
The sort of measurements with which this book is concerned are performance metrics that quantify human achievement and failure.
64%
Flag icon
What kind of information are you thinking of measuring?
65%
Flag icon
How useful is the information?
65%
Flag icon
ask yourself, is what you are measuring a proxy for what you really want to know?
Violeta
ejemplo: ingresos, ocupación y escolaridad, usados como proxy de clase social.
65%
Flag icon
How useful are more metrics?
65%
Flag icon
What are the costs of not relying upon standardized measurement?
65%
Flag icon
to whom will the information be made transparent?
66%
Flag icon
What are the costs of acquiring the metrics?
66%
Flag icon
Ask why the people at the top of the organization are demanding performance metrics.
66%
Flag icon
How and by whom are the measures of performance developed?