What do you think?
Rate this book
1813 pages, Kindle Edition
First published March 11, 2015
Epistemic rationality: to systematically improve the probabilities of beliefs.
Instrumental rationality: to systematically improve at achieving goals.
If you're explicitly setting out to build community—then right after a move is when someone most lacks community, when they most need your help. It's also an opportunity for the band to grow. If anything, tribes ought to be competing at quarterly exhibitions to capture newcomers.
The bottom line of the Dune trilogy is: beware of heroes. Much better rely on your own judgment, and your own mistakes.
These essays are fumbling attempts to put into words lessons that would be better taught by experience. But at least there’s underlying math, plus experimental evidence from cognitive psychology on how humans actually think. Maybe that will be enough to cross the stratospherically high threshold required for a discipline that lets you actually get it right, instead of just constraining you to interesting new mistakes.
everyone needs to learn at least one technical subject. Physics; computer science; evolutionary biology; or Bayesian probability theory, but something. Someone with no technical subjects under their belt has no referent for what it means to "explain" something. They may think "All is Fire" is an explanation.
*Some of Yudkowsky's new ideas (not the mere popularisations):
The abstract research chain into FAI: i.e. logical uncertainty, tiling, corrigibility, value learning. The leading academic textbook on AI gives a full page to his ideas.
Pascal's mugging (see final footnote here).
A new completeness theorem in probabilistic logic, discussed by a big-name mathematical physicist here.
The term "Friendly AI"
Probably the first to tie the Jaynesian probability calculus plus the Heuristics and Biases program plus rule-utilitarianism.