What do you think?
Rate this book


238 pages, Kindle Edition
First published June 23, 2026
‘A reverse centaur is a human who is conscripted into acting as an assistant to a machine.’
‘This centaur/reverse centaur distinction is the heart of the paradox at the heart of the debate about the usefulness of AI tools. When you find yourself surrounded by people swearing that a given tool is worse than useless and others swearing that it has madeo their lives easier and better, you can bet that the former group is made up of reverse centaurs who’ve had AI imposed upon them, the latter group is all centaurs who’ve gotten to make up their own minds about where, when, and how to use AI tools. The solution to the paradox is to stop thinking about what the gadget does, and pay attention to who the gadget does it to and who the gadget does it for. The important part isn’t the technical characteristics of the device, it’s the power relationships of the people who use the device.’
‘The social arrangements of technology are a choice, not an inevitability.’
‘Successor technologies to the cash register—like mobile phone attachments that let people process credit card transactions—allow creative workers to sell directly to passersby at art fairs, comic-cons, and flea markets. They enhance the welfare and improve the material circumstances of workers. The most important thing about the gadget isn’t what it does, it’s who it does it for and who it does it to.’
‘Inevitabilists will tell you a version of this story whose moral is, See, you take the good with the bad. They’re wrong. You don’t have to take the good with the bad. You can get the good without the bad. The difference isn’t to be found in what a technology does; it’s in what your boss uses the technology to inflict upon you. If you want to get the good without the bad, you need to switch from fighting technologies to fighting bosses.’
‘The IG app, for example, tracks everything from how quickly you scroll, what’s on the screen when you stop scrolling (or just slow down), even readings from your phone’s accelerometer—how you’re holding and moving your phone while you interact with their app. All this can be correlated with your location, the specifications of your device, and your other activities—the places you’ve visited recently, the places you subsequently visit, the things you buy, and the people you converse with.’
‘The fact that your technology tools spy on you means that the tech workers who make those tools can be rewarded or punished based on your usage.’
‘The current AI bubble is being driven by large tech firms’ need to tell a growth story to investors, which means that this AI has to be deployed in a way that reduces wages, because that’s the only thing that customers will pay enough for to make all those investors’ money back and more besides. What’s more, the mere existence of a widely accepted AI story can help suppress the wages of workers, even before AI is deployed. Workers who anticipate their imminent replacement by AI can be bullied into accepting worse conditions, dropping unionization demands, and taking other measures that shift the distribution of a firm’s profits from investors to workers.’
‘Never forget that you aren’t the target for AI hype—investors are. To the extent that anyone thinks of you when designing the publicity and marketing campaigns for AI, they are merely hoping that you will be visibly and loudly impressed.’
‘And—sometimes the most efficient way to convince your real target to take action is to act on someone else, someone with little power or agency.’
‘Remember, you aren’t the audience for AI companies’ hype. The real audience is the finance sector. To the extent that you are targeted by AI messaging, it’s in hopes of getting you to evince some kind of behavior that makes investors think there’s something to this AI business.’
‘Tech workers, especially those early workers, were often people whose lives had been transformed for the better by their experiences with networked computers, and many wanted to bring those benefits to the whole world’
‘Does AI really make coders more efficient? That certainly doesn’t seem to be the case for junior coders, whose “vibe coding” efforts might produce quick-and-dirty tools for one-off usage—for example, a script to reformat a single text file, once—but who lack the depth of experience to vet AI-produced production code for subtle errors that accumulate as “technical debt” in the enterprise systems they work on. Worse: without the hard-won experience of creatively solving a succession of programming challenges, these junior coders may never develop the requisite depth of expertise needed to do a thorough review of AI-generated code.’
‘In a world of giant media cartels, giving creative workers new copyrights to bargain with is like giving your bullied schoolkid extra lunch money. It does not matter how much lunch money you give Junior, the bullies are just gonna take that, too. Give your kid enough lunch money and the bullies will amass a fortune large enough to bribe the principal to look the other way. Keep giving that kid more lunch money and the bullies will be able to afford a global advertising campaign demanding more lunch money for all those hungry kids.’
‘Here’s a rule of thumb for tech policy prescriptions. Anytime you find yourself, as a worker, rooting for the same policy as your boss, you should check and make sure you’re on the right side of history.’
‘At a moment when AI algorithms are dictating who gets hired, who gets a loan, and who goes to jail (as well as who gets bombed), Hinton dismisses all of these concerns as not “existentially serious,” and tells us that we need to put all our focus on the coming day when one of these prize AI mares gives birth to a locomotive.’
‘AI is a bubble, but not all bubbles are created equal. Start here, though: every bubble is bad. The foundation of a bubble isn’t just “irrational exuberance” in which retail investors—you and me—unwisely gamble our life savings and lose everything. Bubbles all have winners, and these winners don’t come out on top by accident. Before a stock swindler inflates a bubble, they first acquire a lot of whatever the bubble is for, so they can sell it to us, and make out like a literal and figurative bandit.’
‘Every bubble is a transfer of wealth from savers to crooks. Every bubble is bad. We shouldn’t have bubbles. The pump-and-dumpers who inflate these bubbles should face criminal sanctions. Regulators should intervene to prevent bubble formation in the first place. That said: not all bubbles are created equal. Some bubbles pop and leave nothing behind. These are the pure fraud bubbles.’
‘Defenders of AI will often cite other technologies that were costly at the outset, like the web itself, as evidence that AI will soon solve all its energy and scale problems. But the web revolution was a decade of unbroken drops in the cost of servicing each new web user. In economics terms, the web had great “unit economics”—the cost of each web session fell and fell, even as the cost of getting on the web (from hardware to software to connectivity) was also falling.’
‘Not so with AI. Each generation of AI foundation models has been vastly more expensive to train and operate than the previous generation. Not only that, but many refinements in AI that are meant to improve accuracy and reduce “hallucinations” involve breaking a prompt down into multiple pieces and prompting an AI to respond to each prompt, turning that response into a new prompt, over and over again, to produce “chains of thought.” These are, to quote Ed Zitron, “dogshit unit economics.” AI gets more expensive every time it adds a user. It gets more expensive every time it adds a feature. It gets more expensive every time it improves. This is the opposite of the conditions under which the web attained liftoff.’
‘Companies are not training new foundation models because the old ones are so profitable that their owners have gobs of cash left over to make even better ones. Every AI company is losing money, and the bigger the AI company is, the more money it’s losing. The biggest AI companies are losing billions per quarter.’
‘The financing for new models is coming from investors, and those investors are making a bet that the AI they’re funding will be so good that employers can fire half their workers and replace them with AI, with the proceeds split between AI companies’ customers, and the AI companies themselves. Failing that, they’re making a bet that AI companies’ sales staff can convince employers to fire half their employees and replace them with AI that can’t do their jobs, and that no one will figure this out until after the AI companies’ investors have cashed out.’
‘This may seem like a paltry and trivial outcome from hundreds of billions of dollars and gigatons of planet-killing carbon, because it is. The serious environmental costs of AI will be borne by everyone on the planet, and all the animals and plants we share it with, for hundreds of years to come. Much of that harm is already locked in, and all we can do now is think about how we will mitigate it—how we’ll treat the zoonotic plagues, where we’ll house the climate refugees, how we’ll evacuate our low-lying cities, and how we’ll douse the wildfires.’
‘The economic costs of the AI crash will also be felt around the world, for a generation or more. Those harms are also locked in. You can’t give a third of the S&P 500’s value over to seven money-losing AI companies that energetically pass the same $100 billion IOU around and around without creating the conditions for a prolonged, brutal, global crash.’
‘Remember: all bubbles are terrible, but some bubbles are productive. The stuff that’s left behind when the bubble pops is salvage. Just because we deplore the waste that went into its production, that doesn’t mean we have to contribute to that waste by discarding this perfectly good remnant. There are plenty of uses for chatbots, too. Many, many people report that “conversing” with a chatbot is therapeutic. That’s easy to believe—A chatbot “therapist” is more like an interactive journal, one that feeds you back bland—but increasingly personalised—responses as you spill your guts to it.’
‘To put this in the context of AI art: AI art is uncanny because it has the seeming of intent without an intender, and it grows more meaningful the more a human infuses it with communicative intent. An AI therapist is a chatbot that you iteratively prompt and re-prompt, and the sentences in its replies to you are a higher- and higher-fidelity expression of the communicative intent you infuse into the sentences you feed it. An AI therapy session is a creative work of literature in which you are the principal author and the chatbot is a coauthor that makes successively refined guesses about what you want to hear based on your responses to its responses (to your responses to its responses).’
‘Some people have experienced “AI psychosis” in which they have led their chatbots into extremely destructive conversations wherein the chatbot fed and amplified dangerous delusions. At least one person killed themselves after such an experience.’
‘It’s because this all arrived as part of an investment bubble that was inflated by attacking workers of all kinds, and that stands to destroy the planet and the economy, that we are forced to take sides as either “anti-AI” or “pro-AI.” It’s fine to be “anti–AI bubble,” but it’s pretty silly to be “anti–statistical analysis” and “anti–machine learning” and “anti–automated inference.” Long after the bubble is gone, many of these tools will recede to the status of boring utilities, nurtured by open-source weirdos and a few ambitious startups. That’s not the problem. The problem is that all of today’s nonsense applications of AI will do lasting damage, separate from these perfectly useful utilities.’
‘There’s the obvious, world-threatening harm done by the gigatons of CO2 emitted by AI data centers to perform the redundant and wasteful training processes and to serve queries. Then there’s the world of labour. We’ll see lots of people fired—not because an AI can do their job, but because an AI salesman can convince their credulous bosses to fire them and replace them with an AI that can’t do their job.’
‘That’ll be bad enough. Not only will good people lose their jobs, but the rest of us will lose the value those people produced when they did their jobs. We’ll get bad chatbot advice, bad chatbot diagnoses, bad chatbot recommendations. And then, when the bubble pops, we won’t even have that. Companies will go bust. The data centers where these giant money- and power-sucking foundation models are housed will go dark. This will be even worse than having shitty AI doing important work badly—it will be a time in which that important work won’t be done at all.’
‘The job of a good AI critic is to help pop the bubble as quickly as possible, before the walls of all our institutions are filled with this digital asbestos that we’ll be digging out for generations. To be a good AI critic is to understand the material origins of the bubble, and to strike at the material factors that keep it inflated.’
‘I do a lot of things, but above all, I’m a science fiction writer. I’ve been selling SF stories since I was a teenager. It’s really fun to think about AI, to carry on outlandish thought experiments that challenge us to examine what we think of as intelligence, as agency, as morality. Imaginative exercises, whether undertaken as fiction or as computer code, open your mind to strange possibilities and exciting ideas.’
‘But thought experiments aren’t plans. They’re not predictions. The fact that you’ve seen movies and read books with superintelligent AI in them doesn’t mean that AI is real. It doesn’t mean that it’s likely. It doesn’t even mean that it’s possible.’
‘Many technologists have been inspired by science fiction to create interesting and useful things. The AI scientists who dreamed of better interfaces and came up with the techniques underpinning image generators and large language models did something incredible—But they haven’t invented an intelligent being. They haven’t set in motion the tools to conjure up a new god or demon. They haven’t even invented a tool that can do your job for you.’
‘But there is one thing that—AI bosses who are gunning for generational, dynastic wealth by transforming us all into AI-lashed reverse centaurs—don’t want you to know. That thing is this: the future is up for grabs. It is not inevitable. AI isn’t a genie that can’t be put back into a bottle. How we use AI is up to us. Whether we use AI is up to us. The future can be ours, if we never stop remembering that the most important fact about a technology isn’t what it does, it’s who it does it for, and who it does it to.’