My local library has bought the entire Women’s Prize for Non-Fiction shortlist, and I’m gradually reading my way through it. Madhumita Murgia's Code Dependent: Living in the Shadow of AI is currently second in my rankings, behind A Flat Place but ahead of the actual winner, Doppelgänger, which I felt would have been better as a long essay. As the title suggests, this one is a series of case studies of the impact of AI systems on people’s lives. At first, I found Code Dependent too journalistic and too familiar. The first three chapters showcase material I’d already seen in news reporting and on social media, dealing with ‘deepfakes’, face recognition apps, data-tagging jobs and the hideousness of getting workers in the Global South to filter out violent material from our social media feeds. All important issues, but I not only knew about them but felt they’d been addressed better in fiction, from Cory Doctorow’s prescient For The Win to Lisa Ko’s short story ‘The Contractors'. The last couple chapters, on legal and societal frameworks, were also too broad-brush for me, and I was frustrated by a throwaway sentence that referenced a much more interesting story that Murgia wrote for the Financial Times, on a woman who challenged a new algorithm the NHS uses to allocate livers for transplant (I imagine the FT didn’t allow her to reproduce it here, but such a shame!).
But the middle of the book is much stronger, with great chapters on how the Uber app screws over riders, how AI-powered diagnosis tools can improve healthcare in rural India, and how data collected from families living in Salta, in north-west Argentina, was supposed to improve outcomes for teenage mothers but ended up surveilling families pointlessly. I was most struck by Murgia’s case study of the ProKid machine learning system used in Amsterdam, that collates a list of young people supposedly at risk of committing crimes but, unsurprisingly, both over-represents teenagers of colour and labels them in a way that makes things worse. Not only did young people on the list feel set up for failure, the list was actually used by drug gangs to recruit ‘easy targets’. So much resonance here with the way young people were policed in England and Wales in the inter-war and post-war periods, when, even though there was no AI, their family circumstances and supposed vulnerabilities were used to determine what happened to them in the criminal justice system. So Code Dependent may be patchy, but it’s worth reading, and I was especially impressed by its global reach.