Paths, Dangers, Strategies
This seminal book injects the topic of superintelligence into the academic and popular mainstream. What happens when machines surpass humans in general intelligence? Will artificial agents save or destroy us? In a tour de force of analytic thinking, Bostrom lays a foundation for understanding the future of humanity and intelligent life.
This reminds me of a project started over 10 years ago
Friendly AI 1.0
Great second read on the problem of ASI
For a first entry into the potential danger of ASI I recommend James Barrat's "Our Final Invention" as an easier more direct read, particularly as a layman. Bostrom's excellent and more thorough book is better for those who want to delve deeper into the problem.
Beware: mixing of science and religion
This book may be good fun conjectural entertainment, but I think it’s dangerous to essentially mix science and religious ideas, like the author is doing, whether he realizes he’s doing it or not.