This book may easily win the prize for the best book that no one wants to read. And that is precisely why it is the one book that everyone must read.
Meredith Broussard is a coder, educator, and a computational journalist that specializes in algorithmic accountability reporting. Which is to say that she is a very tech-savvy investigative journalist that emphasizes statistical analysis. (The algorithmic and computational side of it is method more than purpose, to my way of thinking.)
She is most definitely not a Luddite. “My goal in this book is to empower people around technology.” She embraces technology and the power of algorithms, but with a caveat. She is wary of the autonomous school of computing who wants to turn it all over to the machines. And she makes a very strong case that doing so is both impractical, in the foreseeable future, and inappropriate. “We need to stop fetishizing tech.”
It’s an important message. In my own words, machines will never think in the human sense because thought is relative. Even humans have difficulty interpreting reality, which is why so much scientific discovery is ultimately proven to be wrong. All reality exists in context, which means that reality is defined by far more variables than we can comprehend, much less measure and compute. The outer limit may well be infinity.
As a result, any attempt to interpret reality and to use that “data” to think is reliant upon convention and limited representation. And convention is, by definition, imperfect.
Pyrrho of Elis was a not-so-famous Greek philosopher who introduced what ultimately became known as the philosophical school of skepticism. It has been resiliently unpopular for reasons that psychologists can easily explain. Who wants to hang out with skeptics? And connection is ultimately what we all crave.
Pyrrho’s skepticism related to dogma. A dogma is a rule or law or defined procedure or process. A convention is dogma as well. And Pyrrho’s issue with dogma was that whenever you lay it out you have opened the door for a duality—a truth and its exception. There are, quite literally, exceptions to every rule because reality is ultimately defined by an infinite number of variables that can’t be known by either a person or a machine. And that means that the exceptions can never be fully articulated no matter how much computational power you have at your disposal.
Algorithms are ultimately nothing more than mathematical dogma. They can, by definition, never be complete. They will always be limited by probabilities, which is why they work at playing Go and translating language at a superficial level, but will never be the “black box” of human sentient consciousness that we all dream of. Never.
I have witnessed the debilitating over-confidence in tech that Broussard speaks to repeatedly throughout my career in business. Technology is, in many ways, destroying modern business and, in particular, the social contract that employers used to recognize between employer, employee, and community.
Business is consumed with reducing costs, which typically gets falsely interpreted as eliminating bodies. As a result, businesses typically want to automate everything, which, as Broussard explains, means that all of its processes need to be conceptually digitized. They must be restructured to accommodate the very real limitations of mathematics. Which ultimately means that they are often compromised and shaded by the very real personal biases of the person who made the digital conversion.
That works some of the time in some circumstances. But not always. No company will ever be successful in fully automating processes like customer service, sales, quality, and innovation. To the extent they try, moreover, they risk disengaging the people they need to actually make those processes, perhaps assisted by technology, effective.
Broussard has a strong political perspective. We all do. And there are portions of the book where she falls back on her investigative journalism and strays from the overall objective of the book. It’s always to make a relevant point, and she never quite abandons that objective, but the lapses are notable and just a tad distracting.
In part, however, Broussard is admittedly trying to contrast the potential of tech socially and politically with the non-conformist, male-dominated libertarianism of the current tech industry. And that needs to change.
The bigger irony, however, is that a culture and industry built on non-conformity is now ultimately turning back on itself, and is not just promoting, but mandating, the ultimate in conformity. And the hidden risk is that unlike the conformity of things like organized religion, technology is forcing us to conform to norms and standards that we aren’t even aware of because the algorithms that drive our decisions and are filled with the human biases of the people who created them, are largely hidden from view.
And that is ultimately where, I suppose, algorithmic accountability reporting comes in. And I say, “bring it on.” It’s exactly what we need.
In the meantime, however, we need to understand the overriding conceptual paradox of technology. Hal is a myth. The black box is a myth. The autonomous car is a myth (and if we give them broad access to our roads in your lifetime we will regret it). The potential of tech is not a myth. As long as we recognize that humanity is not obsolete, but it is biased.