Melanie’s Reviews > If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All > Status Update

Definitely not a book that could be fairly labeled non-fiction

"We're not sure we know what we're talking about, but we're pretty sure it's scary!"

Authors are conflating "objectives" with "want." I haven't seen the word "motivation" once, and how can an AI even be motivated? It doesn't benefit from rewards.

The people cultivating it aren't actually designing it and don't know how it works, and can't control it.

Not sure I even accept the premise of this. There's a difference between computation and actually thinking, and these machines aren't thinking or evaluating.