Existential Risk


The Precipice
Superintelligence: Paths, Dangers, Strategies
Global Catastrophic Risks
The Alignment Problem: Machine Learning and Human Values
If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All
Nuclear War: A Scenario
Life 3.0: Being Human in the Age of Artificial Intelligence
Human Compatible: Artificial Intelligence and the Problem of Control
X-Risk: How Humanity Discovered Its Own Extinction
The Hanson-Yudkowsky AI-Foom Debate
The Vulnerable World Hypothesis
Command and Control: Nuclear Weapons, the Damascus Accident, and the Illusion of Safety
A City on Mars: Can We Settle Space, Should We Settle Space, and Have We Really Thought This Through?
A Canticle for Leibowitz (St. Leibowitz, #1)
Goliath's Curse: The History and Future of Societal Collapse
Superintelligence by Nick BostromHuman Compatible by Stuart RussellThe Precipice by Toby  OrdLife 3.0 by Max TegmarkSuperforecasting by Philip E. Tetlock
AI Governance
5 books — 1 voter
Superintelligence by Nick BostromReasons and Persons by Derek ParfitGlobal Catastrophic Risks by Nick BostromThe Precipice by Toby  OrdLife 3.0 by Max Tegmark
Effective Altruism Long-Termism Books
21 books — 12 voters

Toby  Ord
If all goes well, human history is just beginning. Humanity is about two hundred thousand years old. But the Earth will remain habitable for hundreds of millions more—enough time for millions of future generations; enough to end disease, poverty and injustice forever; enough to create heights of flourishing unimaginable today. And if we could learn to reach out further into the cosmos, we could have more time yet: trillions of years, to explore billions of worlds. Such a lifespan places humanity ...more
Toby Ord, The Precipice

Since the notion of quality, as understood by [the Swedish Research Council], is supposed to ignore practical applicability, quality as the sole selection criterion means that we value the production of new knowledge and its own right, rather than just a means towards attaining other goals. I have long been – and still am – highly sympathetic to this romantic view of knowledge and intellectual achievements. To improve our understanding of the world we live in really is one of the most magnificen ...more
Olle Häggström, Here Be Dragons: Science, Technology and the Future of Humanity

More quotes...
Harvard-MIT Project on Existential Risk A book group for anyone affiliated with Harvard or MIT who is interested in existential risk and…more
4 members, last active 4 years ago