What happens when computers become as intelligent as humans, relegating us to the second most capable beings on Earth? Will we able to maintain control over their actions? How will they treat their human creators? The AI experts have been pondering these questions for more than half a century, and worrying about their possible consequences. This book explores what might happen in this situation, especially as the Law of Unintended Consequences permits the computers to range far beyond what was intended for them by their designers. The computers might make themselves impervious to external attack, although they would have to figure out how to operate outside their box. This could be done by creating robots which they would control. Then they could compete with humans on every level, including obtaining their own funding, operating their own factories, launching space-borne weapons, and declaring war on every conceivable human institution. Can this ultimate catastrophe be avoided? Perhaps the most prevalent problem involves the interactions between the computers and their creators. But will the scientists be able to recognize when they are about to lose control of their system. Will they be willing to terminate their project just as it gains the goals they’ve been working for years to have it achieve?
I enjoyed reading the book. I hope that the scenario in the book does not happen when ASI becomes a reality. If ASI does in fact become a reality. I found this book a page turner. I couldn't wait to see what would happen to earth.