Questions About Superintelligence: Paths, Dangers, Strategies

by Nick Bostrom (Goodreads Author)

Reader Q&A

To ask other readers questions about Superintelligence, please sign up.

Answered Questions (2)

Here's a naïve question, and perhaps he addresses it (I'm only 1/3 in), but why do we need to create a "goal" for seed A.I. at all? It seems like all the problems arise when we try to create goals--especially the matter of instrumentals goal to acquire resources and create "infrastructure" to carry out final goals.

Ben Pace I am quite unsure what you are imagining when you imply that an AI can have no goals. If the seed AI only wanted to improve itself, that would be it's…moreI am quite unsure what you are imagining when you imply that an AI can have no goals. If the seed AI only wanted to improve itself, that would be it's goal. An AI with no goals does nothing... It's just a rock.

Maybe you had something else in mind. I do not know if you have reached argument for the following statement, but it is argued that if a super intelligent AI has a goal, that AI's goal tends to entirely shape the future. If you make an super intelligent AI without goals, someone else can come along and make an AI with goals, and unless that person has done a helluva lot of work on deciding on the goals, it is also argued that things will be very very bad.(less)

flag

I am very curious who wrote the brief introduction of this book on this webpage (the homepage of this book). In general, who writes introduction of any book on this website? Are they usually a copy from part of the book itself or written by editor from Goodreads? Thanks.

John Park Almost certainly part of the publisher's publicity package. (I don't think Goodreads employs any editors.)…moreAlmost certainly part of the publisher's publicity package. (I don't think Goodreads employs any editors.)(less)

flag

Unanswered Questions

About Goodreads Q&A

Ask and answer questions about books!

You can pose questions to the Goodreads community with Reader Q&A, or ask your favorite author a question with Ask the Author.

See Featured Authors Answering Questions

Learn more