Existential Risk


The Precipice
Superintelligence: Paths, Dangers, Strategies
Global Catastrophic Risks
The Alignment Problem: Machine Learning and Human Values
If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All
What We Owe the Future
Nuclear War: A Scenario
Life 3.0: Being Human in the Age of Artificial Intelligence
Human Compatible: Artificial Intelligence and the Problem of Control
X-Risk: How Humanity Discovered Its Own Extinction
The Hanson-Yudkowsky AI-Foom Debate
The Vulnerable World Hypothesis
Command and Control: Nuclear Weapons, the Damascus Accident, and the Illusion of Safety
A City on Mars: Can We Settle Space, Should We Settle Space, and Have We Really Thought This Through?
A Canticle for Leibowitz (St. Leibowitz, #1)
Superintelligence by Nick BostromA Fractured I.T. by Maurice   JohnsonHuman Compatible by Stuart RussellThe Precipice by Toby  OrdLife 3.0 by Max Tegmark
AI Governance
6 books — 2 voters
Superintelligence by Nick BostromReasons and Persons by Derek ParfitGlobal Catastrophic Risks by Nick BostromThe Precipice by Toby  OrdLife 3.0 by Max Tegmark
Effective Altruism Long-Termism Books
22 books — 13 voters

Nick Bostrom
Our approach to existential risks cannot be one of trial-and-error. There is no opportunity to learn from errors. The reactive approach — see what happens, limit damages, and learn from experience — is unworkable. Rather, we must take a proactive approach. This requires foresight to anticipate new types of threats and a willingness to take decisive preventive action and to bear the costs (moral and economic) of such actions.
Nick Bostrom

But there is a huge difference between, on one hand, admitting that there severe difficulties, and, on the other, throwing our hands in the air and fatalistically declaring the problem to be unsolvable. We don't know that they are in solvable until we tried, and tried really hard. Given the magnitude of what's at stake, just giving up on the problem is in my opinion unacceptable. The extent to which we are currently neglecting the problem is shocking. Nick Bostrom, in a recent paper, illustrates ...more
Olle Häggström, Here Be Dragons: Science, Technology and the Future of Humanity

More quotes...
Harvard-MIT Project on Existential Risk A book group for anyone affiliated with Harvard or MIT who is interested in existential risk and…more
4 members, last active 4 years ago