Existential Risk


The Precipice
Superintelligence: Paths, Dangers, Strategies
Global Catastrophic Risks
The Alignment Problem: Machine Learning and Human Values
If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All
What We Owe the Future
Nuclear War: A Scenario
Life 3.0: Being Human in the Age of Artificial Intelligence
Human Compatible: Artificial Intelligence and the Problem of Control
X-Risk: How Humanity Discovered Its Own Extinction
The Hanson-Yudkowsky AI-Foom Debate
The Vulnerable World Hypothesis
Command and Control: Nuclear Weapons, the Damascus Accident, and the Illusion of Safety
A City on Mars: Can We Settle Space, Should We Settle Space, and Have We Really Thought This Through?
A Canticle for Leibowitz (St. Leibowitz, #1)
How to Survive the Singularity by Dr Norman P JohnsonSuperintelligence by Nick BostromA Fractured I.T. by Maurice   JohnsonHuman Compatible by Stuart RussellThe Precipice by Toby  Ord
AI Governance
7 books — 6 voters
How to Survive the Singularity by Dr Norman P JohnsonSuperintelligence by Nick BostromReasons and Persons by Derek ParfitGlobal Catastrophic Risks by Nick BostromThe Precipice by Toby  Ord
Effective Altruism Long-Termism Books
23 books — 21 voters

Since the notion of quality, as understood by [the Swedish Research Council], is supposed to ignore practical applicability, quality as the sole selection criterion means that we value the production of new knowledge and its own right, rather than just a means towards attaining other goals. I have long been – and still am – highly sympathetic to this romantic view of knowledge and intellectual achievements. To improve our understanding of the world we live in really is one of the most magnificen ...more
Olle Häggström, Here Be Dragons: Science, Technology and the Future of Humanity

No science and no analysis of the future consequences of various actions taken today can in itself tell us what to do. We need, in addition, to factor in what kind of future we value, and to what extent we care at all about the future compared to more immediate concerns here and now. The later aspect is usually modeled and economics by the so-called discount rate, which has played a prominent role in discussions of climate change on a decadal and centennial time scale, but hardly at all in the c ...more
Olle Häggström, Here Be Dragons: Science, Technology and the Future of Humanity

More quotes...
Harvard-MIT Project on Existential Risk A book group for anyone affiliated with Harvard or MIT who is interested in existential risk and…more
4 members, last active 5 years ago