More on this book
Community
Kindle Notes & Highlights
by
Max Tegmark
Read between
January 2, 2021 - November 30, 2023
Thus the first ultraintelligent machine is the last invention that man need ever make, provided that the machine is docile enough to tell us how to keep it under control.”
Life, defined as a process that can retain its complexity and replicate, can develop through three stages: a biological stage (1.0), where its hardware and software are evolved, a cultural stage (2.0), where it can design its software (through learning) and a technological stage (3.0), where it can design its hardware as well, becoming the master of its own destiny.
Hydrogen…, given enough time, turns into people. Edward Robert Harrison, 1995
intelligence is ultimately all about information and computation, not about flesh, blood or carbon atoms.
If we don’t change direction soon, we’ll end up where we’re going. Irwin Corey
Throughout human history, we’ve relied on the same tried-and-true approach to keeping our technology beneficial: learning from mistakes. We invented fire, repeatedly messed up, and then invented the fire extinguisher, fire exit, fire alarm and fire department. We invented the automobile, repeatedly crashed, and then invented seat belts, air bags and self-driving cars.
whereas verification asks “Did I build the system right?,” validation asks “Did I build the right system?”
since the mid-1970s, salaries rose about 25% for those with graduate degrees while the average high school dropout took a 30% pay cut.
since the year 2000, an ever-larger share of corporate income has gone to those who own the companies as opposed to those who work there—and
Lord Acton cautioned in 1887 that “power tends to corrupt and absolute power corrupts absolutely.”
It’s hard to double your money daily (or even annually) in a competitive market where your competition offers products similar to yours for almost zero cost.
The history of life shows it self-organizing into an ever more complex hierarchy shaped by collaboration, competition and control.
flickering alone like transient sparks without ever starting a fire.
Given how ethical views have evolved since the Middle Ages regarding slavery, women’s rights, etc., would we really want people from 1,500 years ago to have a lot of influence over how today’s world is run? If not, why should we try to impose our ethics on future beings that may be dramatically smarter than us?
