Superladiva’s Reviews > If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All > Status Update

“When humans demand that their AIs become capable of doing something new, the entity they get is not something an engineer carefully designed to work in a comfortable and familiar way. It is a mostly-working answer stumbled upon by gradient descent tweaking hundreds of billions of numbers until the entity performs well enough at the task.”