Exhalation

by Ted Chiang

And surely the experience must be similar, for like infernal fire, grief burns but does not consume; instead, it makes the heart vulnerable to further suffering.

“Four things do not come back: the spoken word, the sped arrow, the past life, and the neglected opportunity,”

“Coincidence and intention are two sides of a tapestry, my lord. You may find one more agreeable to look at, but you cannot say one is true and the other is false.”

past and future are the same, and we cannot change either, only know them more fully. My journey to the past had changed nothing, but what I had learned had changed everything, and I understood that it could not have been otherwise. If our lives are tales that Allah tells, then we are the audience as well as the players, and it is by living these tales that we receive their lessons.

Nothing erases the past. There is repentance, there is atonement, and there is forgiveness. That is all, but that is enough.

We are not really consuming air at all. The amount of air that I draw from each day’s new pair of lungs is exactly as much as seeps out through the joints of my limbs and the seams of my casing, exactly as much as I am adding to the atmosphere around me; all I am doing is converting air at high pressure to air at low. With every movement of my body, I contribute to the equalization of pressure in our universe. With every thought that I have, I hasten the arrival of that fatal equilibrium.

analogize to entropy and heat death of our universe

There was widespread panic in the days after the truth first became widely known, as people contemplated for the first time the idea that death was inevitable. Many called for the strict curtailment of activities in order to minimize the thickening of our atmosphere; accusations of wasted air escalated into furious brawls and, in some districts, deaths. It was the shame of having caused these deaths, together with the reminder that it would be many centuries yet before our atmosphere’s pressure became equal to that of the reservoir underground, that enabled the panic to subside. We are not sure precisely how many centuries it will take; additional measurements and calculations are being performed and debated. In the meantime, there is much discussion over how we should spend the time that remains to us.

analogize to climate change reactions

The Reversalists continue their labors, confident that they will one day construct an engine that generates more compression than it uses, a perpetual power source that will restore to the universe its lost vigor. I do not share their optimism; I believe that the process of equalization is inexorable. Eventually, all the air in our universe will be evenly distributed, no denser or more rarefied in one spot than in any other, unable to drive a piston, turn a rotor, or flip a leaf of gold foil. It will be the end of pressure, the end of motive power, the end of thought. The universe will have reached perfect equilibrium.

entropy

The universe began as an enormous breath being held. Who knows why, but whatever the reason, I am glad that it did, because I owe my existence to that fact. All my desires and ruminations are no more and no less than eddy currents generated by the gradual exhalation of our universe. And until this great exhalation is finished, my thoughts live on.

And then, our universe will be in a state of absolute equilibrium. All life and thought will cease and, with them, time itself.

I do not delude myself into thinking that this would be a way for me to live again, because I am not that air, I am the pattern that it assumed, temporarily. The pattern that is me, the patterns that are the entire world in which I live, would be gone.

Which is why I have written this account. You, I hope, are one of those explorers. You, I hope, found these sheets of copper and deciphered the words engraved on their surfaces. And whether or not your brain is impelled by the air that once impelled mine, through the act of reading my words, the patterns that form your thoughts become an imitation of the patterns that once formed mine. And in that way I live again, through you.

I wish you well, explorer, but I wonder: Does the same fate that befell me await you? I can only imagine that it must, that the tendency toward equilibrium is not a trait peculiar to our universe but inherent in all universes. Perhaps that is just a limitation of my thinking, and your people have discovered a source of pressure that is truly eternal. But my speculations are fanciful enough already. I will assume that one day your thoughts too will cease, although I cannot fathom how far in the future that might be. Your lives will end just as ours did, just as everyone’s must. No matter how long it takes, eventually equilibrium will be reached.

Contemplate the marvel that is existence, and rejoice that you are able to do so. I feel I have the right to tell you this because, as I am inscribing these words, I am doing the same.

Most people say that when they first try it, it feels like they’re playing a strange game, one where the goal is to press the button after seeing the flash, and it’s easy to play. But when you try to break the rules, you find that you can’t. If you try to press the button without having seen a flash, the flash immediately appears, and no matter how fast you move, you never push the button until a second has elapsed. If you wait for the flash, intending to keep from pressing the button afterward, the flash never appears. No matter what you do, the light always precedes the button press. There’s no way to fool a Predictor.

super deterministic physics

The heart of each Predictor is a circuit with a negative time delay; it sends a signal back in time. The full implications of the technology will become apparent later, when negative delays of greater than a second are achieved, but that’s not what this warning is about. The immediate problem is that Predictors demonstrate that there’s no such thing as free will. There have always been arguments showing that free will is an illusion, some based on hard physics, others based on pure logic. Most people agree these arguments are irrefutable, but no one ever really accepts the conclusion. The experience of having free will is too powerful for an argument to overrule. What it takes is a demonstration, and that’s what a Predictor provides.

how to reconcile super determinism view of physics with free will

People used to speculate about a thought that destroys the thinker, some unspeakable Lovecraftian horror, or a Gödel sentence that crashes the human logical system. It turns out that the disabling thought is one that we’ve all encountered: the idea that free will doesn’t exist. It just wasn’t harmful until you believed it.

Pretend that you have free will. It’s essential that you behave as if your decisions matter, even though you know they don’t. The reality isn’t important; what’s important is your belief, and believing the lie is the only way to avoid a waking coma. Civilization now depends on self-deception. Perhaps it always has.

And yet I know that, because free will is an illusion, it’s all predetermined who will descend into akinetic mutism and who won’t. There’s nothing anyone can do about it; you can’t choose the effect the Predictor has on you. Some of you will succumb and some of you won’t, and my sending this warning won’t alter those proportions. So why did I do it? Because I had no choice.

Ana hesitates; this is not what she envisioned for herself when she went to college, and for a moment she wonders how it has come to this. As a girl she dreamed of following Fossey and Goodall to Africa; by the time she got out of grad school, there were so few apes left that her best option was to work in a zoo; now she’s looking at a job as a trainer of virtual pets. In her career trajectory you can see the diminution of the natural world, writ small.

Derek studied to be an animator, so in one respect creating digital characters is right up his alley. In other respects, his job is very different from that of a traditional animator. Normally he’d design a character’s gait and its gestures, but with digients those traits are emergent properties of the genome; what he has to do is design a body that manifests the digients’ gestures in a way that people can relate to.

emergent properties

He subscribes to Blue Gamma’s philosophy of AI design: experience is the best teacher, so rather than try to program an AI with what you want it to know, sell ones capable of learning and have your customers teach them.

AI design

The digients learn through positive reinforcement, the way animals do, and their rewards include interactions like being scratched on the head or receiving virtual food pellets.

postive feedback loop training of AI digients

Data Earth’s physics simulation is nowhere near good enough for that—but

The researchers conclude that there’s something missing in the Origami genome, but as far as Derek’s concerned, the fault lies with them. They’re blind to a simple truth: complex minds can’t develop on their own. If they could, feral children would be like any others. And minds don’t grow the way weeds do, flourishing under indifferent attention; otherwise all children in orphanages would thrive. For a mind to even approach its full potential, it needs cultivation by other minds. That cultivation is what he’s trying to provide for Marco and Polo.

“It was something I thought of when I was talking with my sister,” he says. Derek’s sister teaches children born with Down syndrome. “She mentioned that some parents don’t want to push their kids too much, because they’re afraid of exposing them to the possibility of failure. The parents mean well, but they’re keeping their kids from reaching their full potential when they coddle them.”

The idea has been around for a while. Artificial-life hobbyists all agree on the impossibility of digients ever getting legal protection as a class, citing dogs as an example: human compassion for dogs is both deep and wide, but the euthanasia of dogs in pet shelters amounts to an ongoing canine holocaust, and if the courts haven’t put a stop to that, they certainly aren’t going to grant protection to entities that lack a heartbeat. Given this, some owners believe the most they can hope for is legal protection on an individual basis: by filing articles of incorporation on a specific digient, an owner can take advantage of a substantial body of case law that establishes rights for nonhuman entities. Hecht is the first one to have actually done it.

legal rights for AI entities

Brauer and Pearson work for Exponential Appliances, maker of household robots. The robots are examples of old-fashioned AI; their skills are programmed rather than learned, and while they offer some real convenience, they aren’t conscious in any meaningful sense. Exponential regularly releases new versions, advertising each one as being a step closer to the consumer’s dream of AI: a butler that is utterly loyal and attentive from the moment it’s switched on. To Ana this upgrade sequence seems like a walk to the horizon, providing the illusion of progress while never actually getting any closer to the goal. But consumers buy the robots, and they’ve given Exponential a healthy balance sheet, which is what Ana’s looking for.

She wants to tell them that Blue Gamma was more right than it knew: experience isn’t merely the best teacher; it’s the only teacher. If she’s learned anything raising Jax, it’s that there are no shortcuts; if you want to create the common sense that comes from twenty years of being in the world, you need to devote twenty years to the task. You can’t assemble an equivalent collection of heuristics in less time; experience is algorithmically incompressible.

expeeience is the only teacher

She imagines Jax maturing over the years, both in Real Space and in the real world. Imagines him incorporated, a legal person, employed and earning a living. Imagines him as a participant in the digient subculture, a community with enough money and skills to port itself to new platforms when the need arises. Imagines him accepted by a generation of humans who have grown up with digients and view them as potential relationship partners in a way that members of her generation will never be able to. Imagines him loving and being loved, arguing and compromising. Imagines him making sacrifices, some hard and some made easy because they’re for a person he truly cares about.

DACEY’S PATENT AUTOMATIC NANNY

Andoversford.

So it hasn’t been my habit to engage in doomsaying whenever a new product is announced; I’ve welcomed new technology as much as anyone. But when Whetstone released its new search tool Remem, it raised concerns for me in a way none of its predecessors did. Millions of people, some my age but most younger, have been keeping lifelogs for years, wearing personal cams that capture continuous video of their entire lives.

msft recall meta / goog glasses

Now Whetstone aims to change all of that; they claim Remem’s algorithms can search the haystack by the time you’ve finished saying “needle.”

AI impact on human brain

There’s no denying the usefulness of software that can actually answer the question “Where did I put my keys?” But Whetstone is positioning Remem as more than a handy virtual assistant: they want it to take the place of your natural memory.

Rewind by msft

Here was the line at which the pursuit of truth ceased to be an intrinsic good. When the only persons affected have a personal relationship with each other, other priorities are often more important, and a forensic pursuit of the truth could be harmful. Did it really matter whose idea it was to take the vacation that turned out so disastrously? Did you need to know which partner was more forgetful about completing errands the other person requested? I was no expert on marriage, but I knew what marriage counselors said: pinpointing blame wasn’t the answer. Instead, couples needed to acknowledge each other’s feelings and address their problems as a team.

empathy not blaming

When I asked her about couples like Joel and Deirdre, she said, “If your marriage is solid, Remem isn’t going to hurt it. But if you’re the type of person who’s constantly trying to prove that you’re right and your spouse is wrong, then your marriage is going to be in trouble whether you use Remem or not.”

Anyone who has wasted hours surfing the Internet knows that technology can encourage bad habits.

soc media

He talked about the European god and told people that following his rules would improve their lives, but his explanations of how that would do so weren’t particularly persuasive.

queries will take the place of ordinary acts of recall, and Remem will be integrated into their very thought processes. Once that happens, we will become cognitive cyborgs, effectively incapable of misremembering anything; digital video stored on error-corrected silicon will take over the role once filled by our fallible temporal lobes.

computer enhanced humans

An obvious drawback to such reliance is the possibility that people might become virtual amnesiacs whenever the software crashes. But just as worrying to me as the prospect of technological failure was that of technological success: How will it change a person’s conception of herself when she’s only seen her past through the unblinking eye of a video camera? Just as there’s a feedback loop in softening harsh memories, there’s also one at work in the romanticization of childhood memories, and disrupting that process will have consequences.

similar to impact of social media

The earliest birthday I remember is my fourth; I remember blowing out the candles on my cake, the thrill of tearing the wrapping paper off the presents. There’s no video of the event, but there are snapshots in the family album, and they are consistent with what I remember. In fact, I suspect I no longer remember the day itself. It’s more likely that I manufactured the memory when I was first shown the snapshots, and over time, I’ve imbued it with the emotion I imagine I felt that day. Little by little, over repeated instances of recall, I’ve created a happy memory for myself.

reconstructive human memory

Regarding the role of truth in autobiography, the critic Roy Pascal wrote, “On the one side are the truths of fact, on the other the truth of the writer’s feeling, and where the two coincide cannot be decided by any outside authority in advance.” Our memories are private autobiographies, and that afternoon with my grandmother features prominently in mine because of the feelings associated with it.

compare soc media

People are made of stories. Our memories are not the impartial accumulation of every second we’ve lived; they’re the narrative that we assembled out of selected moments.

arguably our consciousness

Which is why, even when we’ve experienced the same events as other individuals, we never constructed identical narratives: the criteria used for selecting moments were different for each of us, and a reflection of our personalities.

bayesian updates unique to each person who has a distinct neural network based on experiences

While all lifelogging software has privacy controls in place, most people also grant basic sharing rights: if your actions were recorded in their lifelog, you have access to the footage in which you’re present. So I launched an agent to assemble a partial lifelog from the footage others had recorded, using my GPS history as the basis for the query. Over the course of a week, my request propagated through social networks and public video archives, and I was rewarded with snippets of video ranging from a few seconds in length to a few hours: not just security-cam footage but excerpts from the lifelogs of friends, acquaintances, and even complete strangers.

brave new tech world of no privacy

We don’t normally think of it as such, but writing is a technology, which means that a literate person is someone whose thought processes are technologically mediated. We became cognitive cyborgs as soon as we became fluent readers, and the consequences of that were profound.

readers = cognitive cyborgs ;)

Before a culture adopts the use of writing, when its knowledge is transmitted exclusively through oral means, it can very easily revise its history. It’s not intentional, but it is inevitable; throughout the world, bards and griots have adapted their material to their audiences and thus gradually adjusted the past to suit the needs of the present.

queey whether this is not true of written history as still scribed by humans inteeprwted thru their biased bayesian updaters / neural networks

Anthropologists will tell you that oral cultures understand the past differently; for them, their histories don’t need to be accurate so much as they need to validate the community’s understanding of itself. So it wouldn’t be correct to say that their histories are unreliable; their histories do what they need to do.

again not sure that we can argue any difference w our written histories

Right now each of us is a private oral culture. We rewrite our pasts to suit our needs and support the story we tell about ourselves.

who among us does not have memories that they cannot relate as being associated w their identities now