What do you think?
Rate this book


480 pages, Kindle Edition
Published March 31, 2026

One of the things that Sutskever loved about OpenAI was that it revered engineers ... AI has academic roots, and academics tend to look down on the dirty work of engineering. ... Hassabis and his colleagues disparaged OpenAI's work as engineering-led: all brute force and no intelligence.
But to believers in the singleton vision, OpenAI's founding represented the Fall: the moment when the serpent brought evil into the garden ... Hassabis, ever practical, was also angry in a simpler way. Musk and Hoffman had been invited to the SpaceX gathering [a DeepMind safety board meeting] in good faith. They had sat through the meeting, listened to DeepMind's plans, and then used what they had heard to double-cross him.
... in early 2014, when Elon Musk tried to buy DeepMind, allegedly to safeguard it for humanity. A year later, Musk remained bitter that his bid had been spurned; if he couldn't be the one to build AI, he wanted nobody to do so.
Musk ... continued to fulminate against DeepMind, denouncing Hassabis as an evil genius, the evidence being that Hassabis had once worked on a computer game called Evil Genius.
in 2013, Elon Musk's wife, Talulah Riley - an actress known for playing a seductive TV robot who takes to massacring humans
Once ChatGPT had been embraced by consumers, the incentives for gradualism crumbled.
This is wartime, OpenAI and Microsoft have literally parked the tanks on the lawn.
... Homo sapiens acquired the capacity for abstract thought, some seventy thousand years ago
In 2019, GPT-2 had barely been able to count up to five; it was impressive in the same way that a four-year-old might be. In 2020, GPT-3 was like a nine-year-old
The US-China race dynamic made it almost impossible to stanch the intra-US race dynamic.
"I think political systems will use it to terrorize people," Hinton answered.
"Then why are you doing the research?" Bostrom asked.
"I could give you the usual arguments," Hinton replied. "But the truth is that the prospect of discovery is too sweet."
When Demis talked about the influence of his mother and his horror of manipulating others, he meant it. But it was one thing to abhor the idea of controlling colleagues. Given his Jedi-level charisma, it was quite another to avoid it.
Because of the black-box nature of these networks, the scientists who built them often sounded like surprised parents. Look, my child can say so many more words than just a week ago!
Hassabis was never part of the Singularity crowd. But he shared the assumption that a "singleton" scenario provided the best shot at safe AI ... He imagined convening a band of elite scientists in a secluded research center, there to focus single-mindedly on the birthing of safe superintelligence. This mash-up of Ender's clandestine space station and the Manhattan Project's secret encampment in New Mexico bubbled up in conversation periodically