Existential Risk


The Precipice
Superintelligence: Paths, Dangers, Strategies
Global Catastrophic Risks
The Alignment Problem: Machine Learning and Human Values
If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All
What We Owe the Future
Nuclear War: A Scenario
Life 3.0: Being Human in the Age of Artificial Intelligence
Human Compatible: Artificial Intelligence and the Problem of Control
X-Risk: How Humanity Discovered Its Own Extinction
The Hanson-Yudkowsky AI-Foom Debate
The Vulnerable World Hypothesis
AI Safety: Humanity, Control, and the Race to Keep Superintelligence Aligned
A City on Mars: Can We Settle Space, Should We Settle Space, and Have We Really Thought This Through?
A Canticle for Leibowitz (St. Leibowitz, #1)
How to Survive the Singularity by Dr Norman P JohnsonSuperintelligence by Nick BostromReasons and Persons by Derek ParfitGlobal Catastrophic Risks by Nick BostromThe Precipice by Toby  Ord
Effective Altruism Long-Termism Books
23 books — 20 voters
Visible Ops A.I. by Scott AlldridgeHow to Survive the Singularity by Dr Norman P JohnsonSuperintelligence by Nick BostromA Fractured I.T. by Maurice   JohnsonHuman Compatible by Stuart Russell
AI Governance
8 books — 16 voters

“ But there is a huge difference between, on one hand, admitting that there severe difficulties, and, on the other, throwing our hands in the air and fatalistically declaring the problem to be unsolvable. We don't know that they are in solvable until we tried, and tried really hard. Given the magnitude of what's at stake, just giving up on the problem is in my opinion unacceptable. The extent to which we are currently neglecting the problem is shocking. Nick Bostrom, in a recent paper, illustrates ...more ”
― Olle Häggström, Here Be Dragons: Science, Technology and the Future of Humanity

Toby  Ord
“ If all goes well, human history is just beginning. Humanity is about two hundred thousand years old. But the Earth will remain habitable for hundreds of millions more—enough time for millions of future generations; enough to end disease, poverty and injustice forever; enough to create heights of flourishing unimaginable today. And if we could learn to reach out further into the cosmos, we could have more time yet: trillions of years, to explore billions of worlds. Such a lifespan places humanity ...more ”
― Toby Ord, The Precipice

More quotes...
Harvard-MIT Project on Existential Risk A book group for anyone affiliated with Harvard or MIT who is interested in existential risk and…more
4 members, last active 5 years ago