Francis

31%
Flag icon
In this case, the original AI may be indifferent to its own demise, knowing that its goals will continue to be pursued in the future. It might even choose a strategy in which it malfunctions in some particularly interesting or reassuring way. Though this might cause the AI to be terminated, it might also encourage the engineers who perform the postmortem to believe that they have gleaned a valuable new insight into AI dynamics—leading them to place more trust in the next system they design, and thus increasing the chance that the now-defunct original AI’s goals will be achieved.
Francis
this kind of altruism. Burning ones self for the future of ones species: is exactly what will prove the humanity of so called machine intelligence
Superintelligence: Paths, Dangers, Strategies
Rate this book
Clear rating
Open Preview