What do you think?
Rate this book


41 pages, Kindle Edition
First published April 3, 2019
I gather that soon, perhaps before we could possibly know it given the speed of the deep-learning superintelligences—SIs—in development, yet another self-made apocalypse could be upon us, and so long, folks! Any second now, we might be devoured by a ravening SI with intentions we cannot begin to fathom.
I say yet another because, you know: nuclear weapons, nanotech gray goo, biological warfare—all of which could be SI tools if the initial algorithm on which their self-learning depends decides these methods would further their goals. The standard model is that SIs, presently isolated from the Internet, learn like children, through self-directed assimilation. Developers are gambling they’ll grow up much wiser than us. Given their source material, I find that hope misbegotten. They might choose to love us, but why?
And could their imagined trajectories be any worse than our increasing totalitarianism? Or any worse than one of the main hallmarks of what it means to be human, which is to kill our fellows, or even send our own kin to torture or death if a certain “belief”—whatever a belief might be, neurochemically speaking—has taken up residence in our unfathomable brains?
Bring it on, I say. The change might be for the better.
come to my blog!