Superintelligence: Paths, Dangers, Strategies

by Nick Bostrom

if it is insufficient capability rather than sufficient reliability that makes ordinary software existentially safe, then it is unclear how such software could be a model for a safe superintelligence.