Existential Risk


The Precipice
Superintelligence: Paths, Dangers, Strategies
Global Catastrophic Risks
The Alignment Problem: Machine Learning and Human Values
If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All
What We Owe the Future
Nuclear War: A Scenario
Life 3.0: Being Human in the Age of Artificial Intelligence
Human Compatible: Artificial Intelligence and the Problem of Control
X-Risk: How Humanity Discovered Its Own Extinction
The Hanson-Yudkowsky AI-Foom Debate
The Vulnerable World Hypothesis
Command and Control: Nuclear Weapons, the Damascus Accident, and the Illusion of Safety
A City on Mars: Can We Settle Space, Should We Settle Space, and Have We Really Thought This Through?
A Canticle for Leibowitz (St. Leibowitz, #1)
Superintelligence by Nick BostromReasons and Persons by Derek ParfitGlobal Catastrophic Risks by Nick BostromThe Precipice by Toby  OrdLife 3.0 by Max Tegmark
Effective Altruism Long-Termism Books
21 books — 12 voters
Superintelligence by Nick BostromHuman Compatible by Stuart RussellThe Precipice by Toby  OrdLife 3.0 by Max TegmarkSuperforecasting by Philip E. Tetlock
AI Governance
5 books — 1 voter

Ray Kurzweil
We cannot rely on trial-and-error approaches to deal with existential risks… We need to vastly increase our investment in developing specific defensive technologies… We are at the critical stage today for biotechnology, and we will reach the stage where we need to directly implement defensive technologies for nanotechnology during the late teen years of this century… A self-replicating pathogen, whether biological or nanotechnology based, could destroy our civilization in a matter of days or wee ...more
Ray Kurzweil, The Singularity is Near: When Humans Transcend Biology

Nick Bostrom
Our approach to existential risks cannot be one of trial-and-error. There is no opportunity to learn from errors. The reactive approach — see what happens, limit damages, and learn from experience — is unworkable. Rather, we must take a proactive approach. This requires foresight to anticipate new types of threats and a willingness to take decisive preventive action and to bear the costs (moral and economic) of such actions.
Nick Bostrom

More quotes...
Harvard-MIT Project on Existential Risk A book group for anyone affiliated with Harvard or MIT who is interested in existential risk and…more
4 members, last active 4 years ago