More on this book
Community
Kindle Notes & Highlights
Everyone takes the limits of his own vision for the limits of the world. —ARTHUR SCHOPENHAUER
What, then, is the Singularity? It’s a future period during which the pace of technological change will be so rapid, its impact so deep, that human life will be irreversibly transformed.
the law of accelerating returns (the inherent acceleration of the rate of evolution, with technological evolution as a continuation of biological evolution).
This book will argue, however, that within several decades information based technologies will encompass all human knowledge and proficiency, ultimately including the pattern-recognition powers, problem-solving skills, and emotional and moral intelligence of the human brain itself.
Although impressive in many respects, the brain suffers from severe limitations. We use its massive parallelism (one hundred trillion interneuronal connections operating simultaneously) to quickly recognize subtle patterns. But our thinking is extremely slow: the basic neural transactions are several million times slower than contemporary electronic circuits. That makes our physiological bandwidth for processing new information extremely limited compared to the exponential growth of the overall human knowledge base.
We will be able to live as long as we want (a subtly different statement from saying we will live forever).
By the end of this century, the nonbiological portion of our intelligence will be trillions of trillions of times more powerful than unaided human intelligence.
There will be no distinction, post-Singularity, between human and machine or between physical and virtual reality.
If you wonder what will remain unequivocally human in such a world, it’s simply this quality: ours is the species that inherently seeks to extend its physical and mental reach beyond current limitations. Many commentators on these changes focus on what they perceive as a loss of some vital aspect of our humanity that will result from this transition. This perspective stems, however, from a misunderstanding of what our technology will become. All the machines we have met to date lack the essential subtlety of human biological qualities. Although the Singularity has many faces, its most
...more
Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an “intelligence explosion,” and the intelligence of man would be left far behind. Thus the first ultraintelligent machine is the last invention that man need ever make. —IRVING JOHN GOOD, “SPECULATIONS CONCERNING THE FIRST ULTRAINTELLIGENT MACHINE,” 1965
Perhaps most important, machines can share their knowledge at extremely high speed, compared to the very slow speed of human knowledge-sharing through language.
Most important, the intelligence that will emerge will continue to represent the human civilization, which is already a human-machine civilization. In other words, future machines will be human, even if they are not biological.
The Cambrian explosion provided a stable set of animal body plans (in DNA), so that the evolutionary process could concentrate on more complex cerebral development. In technology, the invention of the computer provided a means for human civilization to store and manipulate ever more complex sets of information. The extensive interconnectedness of the Internet provides for even greater complexity.
By the time of the Singularity, there won’t be a distinction between humans and technology. This is not because humans will have become what we think of as machines today, but rather machines will have progressed to be like humans and beyond.
But the printed book, like any other technology, will not live forever.
Wolfram makes the following point repeatedly: “Whenever a phenomenon is encountered that seems complex it is taken almost for granted that the phenomenon must be the result of some underlying mechanism that is itself complex. But my discovery that simple programs can produce great complexity makes it clear that this is not in fact correct.”
Wolfram goes on to describe how simple computational mechanisms can exist in nature at different levels, and he shows that these simple and deterministic mechanisms can produce all of the complexity that we see and experience. He provides myriad examples, such as the pleasing designs of pigmentation on animals, the shape and markings of shells, and patterns of turbulence (such as the behavior of smoke in the air).
Productivity (economic output per worker) has also been growing exponentially. These statistics are in fact greatly understated because they do not fully reflect significant improvements in the quality and features of products and services. It is not the case that “a car is a car”; there have been major upgrades in safety, reliability, and features. Certainly, one thousand dollars of computation today is far more powerful than one thousand dollars of computation ten years ago (by a factor of more than one thousand). There are many other such examples. Pharmaceutical drugs are increasingly
...more
The need to congregate workers in offices will gradually diminish. From the experience of my own companies, we are already able to effectively organize geographically disparate teams, something that was far more difficult a decade ago. The full-immersion visual-auditory virtual-reality environments, which will be ubiquitous during the second decade of this century, will hasten the trend toward people living and working wherever they wish. Once we have full-immersion virtual-reality environments incorporating all of the senses, which will be feasible by the late 2020s, there will be no reason
...more
As Sun Tzu pointed out, “knowledge is power,” and another ramification of the law of accelerating returns is the exponential growth of human knowledge, including intellectual property.
Automation started by amplifying the power of our muscles and in recent times has been amplifying the power of our minds.
if you can build genuine AI, there are reasons to believe that you can build things like neurons that are a million times faster. That leads to the conclusion that you can make systems that think a million times faster than a person. With AI, these systems could do engineering design. Combining this with the capability of a system to build something that is better than it, you have the possibility for a very abrupt transition.
As we reverse engineer our bodies and brains, we will be in a position to create comparable systems that are far more durable and that operate thousands to millions of times faster than our naturally evolved systems. Our electronic circuits are already more than one million times faster than a neuron’s electrochemical processes, and this speed is continuing to accelerate.
In terms of computation, and just considering the electromagnetic interactions, there are at least 1015 changes in state per bit per second going on inside a 2.2-pound rock, which effectively represents about 1042 (a million trillion trillion trillion) calculations per second. Yet the rock requires no energy input and generates no appreciable heat.
We will transcend biology, but not our humanity.
I set the date for the Singularity—representing a profound and disruptive transformation in human capability—as 2045. The nonbiological intelligence created in that year will be one billion times more powerful than all human intelligence today.
A key advantage of nonbiological intelligence is that machines can easily share their knowledge. If you learn French or read War and Peace, you can’t readily download that learning to me, as I have to acquire that scholarship the same painstaking way that you did. I can’t (yet) quickly access or transmit your knowledge,
By the 2020s nanobot technology will be viable, and brain scanning will be one of its prominent applications.
The reason memories can remain intact even if three quarters of the connections have disappeared is that the coding method used appears to have properties similar to those of a hologram. In a hologram, information is stored in a diffuse pattern throughout an extensive region. If you destroy three quarters of the hologram, the entire image remains intact, although with only one quarter of the resolution.
the detailed arrangement of connections and synapses in a given region is a direct product of how extensively that region is used. As brain scanning has attained sufficiently high resolution to detect dendritic spine growth and the formation of new synapses, we can see our brain grow and adapt to literally follow our thoughts. This gives new shades of meaning to Descartes’ dictum “I think therefore I am.”
Extensive literature supports the use of what I call “hypothesis and test” in more complex pattern-recognition tasks. The cortex makes a guess about what it is seeing and then determines whether the features of what is actually in the field of view match its hypothesis.103 We are often more focused on the hypothesis than the actual test, which explains why people often see and hear what they expect to perceive rather than what is actually there. “Hypothesis and test” is also a useful strategy in our computer-based pattern-recognition systems.
Work by physiology professor Benjamin Libet at the University of California at Davis shows that neural activity to initiate an action actually occurs about a third of a second before the brain has made the decision to take the action. The implication, according to Libet, is that the decision is really an illusion, that “consciousness is out of the loop.” The cognitive scientist and philosopher Daniel Dennett describes the phenomenon as follows: “The action is originally precipitated in some part of the brain, and off fly the signals to muscles, pausing en route to tell you, the conscious
...more
Although the mechanisms are not yet understood, these regions are critical to self-awareness and complicated emotions. They are also much smaller in other animals. For example, the VMpo is about the size of a grain of sand in macaque monkeys and even smaller in lower-level animals. These findings are consistent with a growing consensus that our emotions are closely linked to areas of the brain that contain maps of the body, a view promoted by Dr. Antonio Damasio at the University of Iowa.116 They are also consistent with the view that a great deal of our thinking is directed toward our bodies:
...more
Anthropologists believe that spindle cells made their first appearance ten to fifteen million years ago in the as-yet-undiscovered common ancestor to apes and early hominids (the family of humans) and rapidly increased in numbers around one hundred thousand years ago. Interestingly, spindle cells do not exist in newborn humans but begin to appear only at around the age of four months and increase significantly from ages one to three. Children’s ability to deal with moral issues and perceive such higher-level emotions as love develop during this same time period.
It is important to point out that the spindle cells are not doing rational problem solving, which is why we don’t have rational control over our responses to music or over falling in love. The rest of the brain is heavily engaged, however, in trying to make sense of our mysterious high-level emotions.
Uploading a human brain means scanning all of its salient details and then reinstantiating those details into a suitably powerful computational substrate. This process would capture a person’s entire personality, memory, skills, and history. If we are truly capturing a particular person’s mental processes, then the reinstantiated mind will need a body, since so much of our thinking is directed toward physical needs and desires.
NED: You’re missing something. Biological is what we are. I think most people would agree that being biological is the quintessential attribute of being human. RAY: That’s certainly true today. NED: And I plan to keep it that way. RAY: Well, if you’re speaking for yourself, that’s fine with me. But if you stay biological and don’t reprogram your genes, you won’t be around for very long to influence the debate.
As nanobased replicators become more sophisticated, more capable of extracting carbon atoms and carbon-based molecular fragments from less well-controlled source materials, and able to operate outside of controlled replicator enclosures such as in the biological world, they will have the potential to present a grave threat to that world.
Indeed, if Smalley’s critique were valid, none of us would be here to discuss it, because life itself would be impossible, given that biology’s assembler does exactly what Smalley says is impossible.
Creating this many nanobots at reasonable cost will require self-replication at some level, which while solving the economic issue will introduce potentially grave dangers, a concern I will address in chapter 8. Biology uses the same solution to create organisms with trillions of cells, and indeed we find that virtually all diseases derive from biology’s self-replication process gone awry.
“When a scientist says something is possible, they’re probably underestimating how long it will take. But if they say it’s impossible, they’re probably wrong.”
Biological systems can fly, but if you want to fly at thirty thousand feet and at hundreds or thousands of miles per hour, you would use our modern technology, not proteins. Biological systems such as human brains can remember things and do calculations, but if you want to do data mining on billions of items of information, you would want to use electronic technology, not unassisted human brains.
A primary implication of the nanotechnology revolution is that physical technologies, such as manufacturing and energy, will become governed by the law of accelerating returns. All technologies will essentially become information technologies, including energy.
It’s interesting to compare these figures to the total metabolic energy output of all humans, estimated by Robert Freitas at 1012 watts, and that of all vegetation on Earth, at 1014 watts. Freitas also estimates that the amount of energy we could produce and use without disrupting the global energy balance required to maintain current biological ecology (referred to by climatologists as the “hypsithermal limit”) is around 1015 watts. This would allow a very substantial number of nanobots per person for intelligence enhancement and medical purposes, as well as other applications, such as
...more
Nanosolar has a design based on titanium oxide nanoparticles that can be mass-produced on very thin flexible films. CEO Martin Roscheisen estimates that his technology has the potential to bring down solar-power costs to around fifty cents per watt by 2006, lower than that of natural gas.137 Competitors Nanosys and Konarka have similar projections.
Will robots inherit the earth? Yes, but they will be our children. —MARVIN MINSKY, 1995
When using GAs you must, however, be careful what you ask for. University of Sussex researcher Jon Bird used a GA to optimally design an oscillator circuit. Several attempts generated conventional designs using a small number of transistors, but the winning design was not an oscillator at all but a simple radio circuit. Apparently the GA discovered that the radio circuit picked up an oscillating hum from a nearby computer.176 The GA’s solution worked only in the exact location on the table where it was asked to solve the problem.
A long-standing conjecture in algebra was finally proved by an AI system at Argonne National Laboratory. Human mathematicians called the proof “creative.”