More on this book
Community
Kindle Notes & Highlights
Most individual and institutional decisions are designed to regulate the levels in stocks. If inventories rise too high, then prices are cut or advertising budgets are increased, so that sales will go up and inventories will fall. If the stock of food in your kitchen gets low, you go to the store. As the stock of growing grain rises or fails to rise in the fields, farmers decide whether to apply water or pesticide, grain companies decide how many barges to book for the harvest, speculators bid on future values of the harvest, cattle growers build up or cut down their herds. Water levels in
...more
Instead of seeing only how A causes B, you’ll begin to wonder how B may also influence A—and how A might reinforce or reverse itself. When you hear in the nightly news that the Federal Reserve Bank has done something to control the economy, you’ll also see that the economy must have done something to affect the Federal Reserve Bank. When someone tells you that population growth causes poverty, you’ll ask yourself how poverty may cause population growth. THINK ABOUT THIS: If A causes B, is it possible that B also causes A? You’ll be thinking not in terms of a static world, but a dynamic one.
...more
Bounded rationality means that people make quite reasonable decisions based on the information they have. But they don’t have perfect information, especially about more distant parts of the system. Fishermen don’t know how many fish there are, much less how many fish will be caught by other fishermen that same day. Businessmen don’t know for sure what other businessmen are planning to invest, or what consumers will be willing to buy, or how their products will compete. They don’t know their current market share, and they don’t know the size of the market. Their information about these things
...more
We don’t even interpret perfectly the imperfect information that we do have, say behavioral scientists. We misperceive risk, assuming that some things are much more dangerous than they really are and others much less. We live in an exaggerated present—we pay too much attention to recent experience and too little attention to the past, focusing on current events rather than long-term behavior. We discount the future at rates that make no economic or ecological sense. We don’t give all incoming signals their appropriate weights. We don’t let in at all news we don’t like, or information that
...more
Change comes first from stepping outside the limited information that can be seen from any single place in the system and getting an overview. From a wider perspective, information flows, goals, incentives, and disincentives can be restructured so that separate, bounded, rational actions do add up to results that everyone desires.
The balancing feedback loop that should keep the system state at an acceptable level is overwhelmed by a reinforcing feedback loop heading downhill. The lower the perceived system state, the lower the desired state. The lower the desired state, the less discrepancy, and the less corrective action is taken. The less corrective action, the lower the system state. If this loop is allowed to run unchecked, it can lead to a continuous degradation in the system’s performance. Another name for this system trap is “eroding goals.” It is also called the “boiled frog syndrome,” from the old story (I
...more
Escalation also could be about peacefulness, civility, efficiency, subtlety, quality. But even escalating in a good direction can be a problem, because it isn’t easy to stop. Each hospital trying to outdo the others in up-to-date, powerful, expensive diagnostic machines can lead to out-of-sight health care costs. Escalation in morality can lead to holier-than-thou sanctimoniousness. Escalation in art can lead from baroque to rococo to kitsch. Escalation in environmentally responsible lifestyles can lead to rigid and unnecessary puritanism. Escalation, being a reinforcing feedback loop, builds
...more
This highlight has been truncated due to consecutive passage length restrictions.
Another expression of this trap was part of the critique of capitalism by Karl Marx. Two firms competing in the same market will exhibit the same behavior as two species competing in a niche. One will gain a slight advantage, through greater efficiency or smarter investment or better technology or bigger bribes, or whatever. With that advantage, the firm will have more income to invest in productive facilities or newer technologies or advertising or bribes. Its reinforcing feedback loop of capital accumulation will be able to turn faster than that of the other firm, enabling it to produce
...more
The gross national product does not allow for the health of our children, the quality of their education or the joy of their play. It does not include the beauty of our poetry or the strength of our marriages, the intelligence of our public debate or the integrity of our public officials. It measures neither our wit nor our courage, neither our wisdom nor our learning, neither our compassion nor our devotion to our country, it measures everything in short, except that which makes life worthwhile.16 We have a system of national accounting that bears no resemblance to the national economy
...more
The GNP lumps together goods and bads. (If there are more car accidents and medical bills and repair bills, the GNP goes up.) It counts only marketed goods and services. (If all parents hired people to bring up their children, the GNP would go up.) It does not reflect distributional equity. (An expensive second home for a rich family makes the GNP go up more than an inexpensive basic home for a poor family.) It measures effort rather than achievement, gross production and consumption rather than efficiency. New light bulbs that give the same light with one-eighth the electricity and that last
...more
I said a while back that changing the players in the system is a low-level intervention, as long as the players fit into the same old system. The exception to that rule is at the top, where a single player can have the power to change the system’s goal. I have watched in wonder as—only very occasionally—a new leader in an organization, from Dartmouth College to Nazi Germany, comes in, enunciates a new goal, and swings hundreds or thousands or millions of perfectly intelligent, rational people off in a new direction.
The ancient Egyptians built pyramids because they believed in an afterlife. We build skyscrapers because we believe that space in downtown cities is enormously valuable. Whether it was Copernicus and Kepler showing that the earth is not the center of the universe, or Einstein hypothesizing that matter and energy are interchangeable, or Adam Smith postulating that the selfish actions of individual players in markets wonderfully accumulate to the common good, people who have managed to intervene in systems at the level of paradigm have hit a leverage point that totally transforms systems.
A new information feedback loop at this point in this system will make it behave much better. But the decision makers are resistant to the information they need! They don’t pay attention to it, they don’t believe it, they don’t know how to interpret it. Why do people actively sort and screen information the way they do? How do they determine what to let in and what to let bounce off, what to reckon with and what to ignore or disparage? How is it that, exposed to the same information, different people absorb different messages, and draw different conclusions? If this feedback loop could just be
...more
This highlight has been truncated due to consecutive passage length restrictions.
Get the Beat of the System Before you disturb the system in any way, watch how it behaves. If it’s a piece of music or a whitewater rapid or a fluctuation in a commodity price, study its beat. If it’s a social system, watch it work. Learn its history. Ask people who’ve been around a long time to tell you what has happened. If possible, find or make a time graph of actual data from the system—peoples’ memories are not always reliable when it comes to timing.
Starting with the behavior of the system directs one’s thoughts to dynamic, not static, analysis—not only to “What’s wrong?” but also to “How did we get there?” “What other behavior modes are possible?” “If we don’t change direction, where are we going to end up?” And looking to the strengths of the system, one can ask “What’s working well here?”
starting with history discourages the common and distracting tendency we all have to define a problem not by the system’s actual behavior, but by the lack of our favorite solution. (The problem is, we need to find more oil. The problem is, we need to ban abortion. The problem is, we don’t have enough salesmen. The problem is, how can we attract more growth to this town?)
Expose Your Mental Models to the Light of Day When we draw structural diagrams and then write equations, we are forced to make our assumptions visible and to express them with rigor. We have to put every one of our assumptions about the system out where others (and we ourselves) can see them. Our models have to be complete, and they have to add up, and they have to be consistent. Our assumptions can no longer slide around (mental models are very slippery), assuming one thing for purposes of one discussion and something else contradictory for purposes of the next discussion.