Life 3.0: Being Human in the Age of Artificial Intelligence

by Max Tegmark

“alien hand syndrome,”

Another fascinating controversy is whether experiments underestimate how much we’re conscious of.

inattentional blindness

people can’t be trusted about what they say they experienced,

Murray Shanahan

our current inability to give a complete answer doesn’t prevent us from giving partial answers.

qualia

Scott Aaronson’s

a highly intelligent AI is programmed to have virtually any sufficiently ambitious goal, it’s likely to strive for self-preservation in order to be able to accomplish that goal.

there would be less of a distinction between you and me if we could easily share and copy all our memories and abilities,

quibbling

any conscious decision maker will subjectively feel that it has free will, regardless of whether it’s biological or artificial.”

Seth Lloyd,

a famous computer-science theorem saying that for almost all computations, there’s no faster way of determining their outcome than actually running them.

hubristic

Steven Weinberg

“The more the universe seems comprehensible, the more it also seems pointless.”

sapience (the ability to think intelligently)

sentience (the ability to subjectively experience qualia).

Since there can be no meaning without consciousness, it’s not our Universe giving meaning to conscious beings, but conscious beings giving meaning to our Universe.

“élan

The saddest aspect of life right now is that science gathers knowledge faster than society gathers wisdom. Isaac Asimov

I made a New Year’s resolution for 2014 that I was no longer allowed to complain about anything without putting some serious thought into what I could personally do about it,

Future of Life Institute (FLI),

the Foundational Questions Institute (see http://fqxi.org),

Demis Hassabis,

Jaan Tallinn

Gradually, we started realizing that our bodies were also machines.

Viktoriya Krakovna,

moonshot

“with artificial intelligence, we are summoning the demon,”

Nielsen ratings

Meia and I went to visit our parents in Sweden and Romania

my dad in Stockholm.

RUD, “rapid unscheduled di...

Bart Selman

The Open Philanthropy Project,

Asilomar conference

with a billion-dollar commitment, Elon Musk partnered with other entrepreneurs to launch OpenAI, a nonprofit company in San Francisco pursuing beneficial AI.

Race Avoidance: Teams developing AI systems should actively cooperate to avoid corner-cutting on safety standards.

Shared Prosperity: The economic prosperity created by AI should be shared broadly, to benefit all of humanity.

Human Control: Humans should choose how and whether to delegate decisions to AI systems, to accomplish human-chosen objectives.

http://futureoflife.org/​ai-principles.

Asilomar AI Principles

positive visions form the foundation of a large fraction of all collaboration in the world,