More on this book
Community
Kindle Notes & Highlights
by
Jaron Lanier
Read between
July 2 - July 4, 2018
even though we love dogs, we don’t want to be dogs, at least in terms of power relationships with people, and we’re afraid Facebook and the like are turning us into dogs. When we are triggered to do something crappy online, we might call it a response to a “dog whistle.” Dog whistles can only be heard by dogs. We worry that we’re falling under stealthy control.
So-called advertisers can seize the moment when you are perfectly primed and then influence you with messages that have worked on other people who share traits and situations with you. I say “so-called” because it’s just not right to call direct manipulation of people advertising. Advertisers used to have a limited chance to make a pitch, and that pitch might have been sneaky or annoying, but it was fleeting. Furthermore, lots of people saw the same TV or print ad; it wasn’t adapted to individuals. The biggest difference was that you weren’t monitored and assessed all the time so that you
...more
What might once have been called advertising must now be understood as continuous behavior modification on a titanic scale.
We need to sort of give you a little dopamine hit every once in a while, because someone liked or commented on a photo or a post or whatever.… It’s a social-validation feedback loop … exactly the kind of thing that a hacker like myself would come up with, because you’re exploiting a vulnerability in human psychology.… The inventors, creators—it’s me, it’s Mark [Zuckerberg], it’s Kevin Systrom on Instagram, it’s all of these people—understood this consciously. And we did it anyway … it literally changes your relationship with society, with each other.… It probably interferes with productivity
...more
The core process that allows social media to make money and that also does the damage to society is behavior modification. Behavior modification entails methodical techniques that change behavioral patterns in animals and people. It can be used to treat addictions, but it can also be used to create them.
If someone gets a reward—whether it’s positive social regard or a piece of candy—whenever they do a particular thing, then they’ll tend to do more of that thing. When people get a flattering response in exchange for posting something on social media, they get in the habit of posting more.
The power of what other people think has proven to be intense enough to modify the behavior of subjects participating in famous studies like the Milgram Experiment and the Stanford Prison Experiment. Normal, noncriminal people were coerced into doing horrible things, such as torturing others, through no mechanism other than social pressure.
Everybody suffers from social anxiety from time to time, and every child has encountered a bully who used social anxiety as a weapon of torture, probably because behaving like a bully lessened the chances that the bully might become a target. That’s why people, even those who would normally be decent, tend to pile on to a victim of social anxiety torture. They’re so afraid of the very real pain that social anxiety brings that they can lose sight of their better natures for a moment.
Negative emotions such as fear and anger well up more easily and dwell in us longer than positive ones. It takes longer to build trust than to lose trust. Fight-or-flight responses occur in seconds, while it can take hours to relax. This is true in real life, but it is even more true in the flattened light of algorithms.
Social media is biased, not to the Left or the Right, but downward. The relative ease of using negative emotions for the purposes of addiction and manipulation makes it relatively easier to achieve undignified results. An unfortunate combination of biology and math favors degradation of the human world. Information warfare units sway elections, hate groups recruit, and nihilists get amazing bang for the buck when they try to bring society down.
With nothing else to seek but attention, ordinary people tend to become assholes, because the biggest assholes get the most attention. This inherent bias toward assholedom flavors the action of all the other parts of the BUMMER machine.
Everyone is placed under a level of surveillance straight out of a dystopian science fiction novel.
Spying is accomplished mostly through connected personal devices—especially, for now, smartphones—that people keep practically glued to their bodies. Data are gathered about each person’s communications, interests, movements, contact with others, emotional reactions to circumstances, facial expressions, purchases, vital signs: an ever growing, boundless variety of data. If you’re reading this on an electronic device, for instance, there’s a good chance an algorithm is keeping a record of data such as how fast you read or when you take a break to check something else.
The deeply addicted person’s rhythm becomes nervous, a compulsive pecking at his situation; he’s always deprived, rushing for affirmation. Addicts become anxious, strangely focused on portentous events that aren’t visible to others. They are selfish, so wrapped up in their cycle that they don’t have much time to notice what others are feeling or thinking about. There’s an arrogance, a fetish for exaggeration, that by all appearances is a cover for profound insecurity. A personal mythology overtakes addicts. They see themselves grandiosely and, as they descend further into addiction, ever less
...more
One must be followed more than one follows, for appearances’ sake.
Briefly I was one of the HuffPost’s top bloggers, always on the front page. But I found myself falling into that old problem again whenever I read the comments, and I could not get myself to ignore them. I would feel this weird low-level boiling rage inside me. Or I’d feel this absurd glow when people liked what I wrote, even if what they said didn’t indicate that they had paid much attention to it. Comment authors were mostly seeking attention for themselves. We were all in the same stew, manipulating each other, inflating ourselves.
we become obsessed with and controlled by a pecking order. We pounce on those below us, lest we be demoted, and we do our best to flatter and snipe at those above us at the same time. Our peers flicker between “ally” and “enemy” so quickly that we cease to perceive them as individuals. They become archetypes from a comic book. The only constant basis of friendship is shared antagonism toward other packs.
In BUMMERland, it seems as if every little comment either turns into a contest for total personal invalidation and destruction, or else everyone has to get all nicey-nicey and fake. The obvious example is that the BUMMER-addicted U.S. president, the social media addict–in—chief, turns everything into a contest over who can destroy someone else most completely with a tweet, or else who gets good treatment in exchange for total loyalty.
If, when you participate in online platforms, you notice a nasty thing inside yourself, an insecurity, a sense of low self-esteem, a yearning to lash out, to swat someone down, then leave that platform. Simple.
But I am also asking you to notice, within your own mind, in genuine secrecy—don’t share this—if you are feeling the temptation to strike out at someone else online. Maybe that other person started it. Whatever. It isn’t worth it. Leave the platform. Don’t post that insult video, don’t tweet in retaliation.
A Assholes change discourse into discharge. They turn the Solitary/Pack switch to Pack, which makes people pay so much attention to social status competition that they can become blinded to everything else, to any broader or more fundamental truth.
What if listening to an inner voice or heeding a passion for ethics or beauty were to lead to more important work in the long term, even if it measured as less successful in the moment? What if deeply reaching a small number of people matters more than reaching everybody with nothing?
When writers become less motivated by the desire to reach people directly, but instead must appeal to a not necessarily reliable number-dispensing system, then writers are losing their connection to their context. The more successful a writer is in this system, the less she knows what she’s writing.
Addiction is associated with anhedonia, the lessened ability to take pleasure from life apart from whatever one is addicted to, and social media addicts appear to be prone to long-term anhedonia.15
BUMMER makes me feel judged within an unfair and degrading competition, and to no higher purpose.
I don’t mind being judged if the judges put in real effort, and a higher purpose is being honestly served, but I really don’t like it when a crowd judges me casually, or when a stupid algorithm has power over me.
The inability to carve out a space in which to invent oneself without constant judgment; that is what makes me unhappy. How can you have self-esteem when that’s not the kind of esteem that matters most anymore? How can you find happiness without authentic self-esteem? How can you be authentic when everything you read, say, or do is being fed into a judgment machine?
Ultimately, only one method of reconciliation was identified: the advertising business model. Advertising would allow search to be free, music to be free, and news to be free. (That didn’t mean that musicians or reporters got a piece of the pie, for the techies considered them replaceable.)
As often happens with people, we forgot that we made a choice. Now we feel helpless. But the choice remains, and we can remake it.
In some alternative universe—a universe we must build if we are to survive—there will be both the convenience of an app like Uber and a sustainable social and economic fabric in which a lot of people build security with dignity.
What social media did at that time, and what it always does, is create illusions: that you can improve society by wishes alone; that the sanest people will be favored in cutting contests; and that somehow material well-being will just take care of itself. What actually happens, always, is that the illusions fall apart when it is too late, and the world is inherited by the crudest, most selfish, and least informed people. Anyone who isn’t an asshole gets hurt the most.
Memes might seem to amplify what you are saying, but that is always an illusion. You might launch an infectious meme about a political figure, and you might be making a great point, but in the larger picture, you are reinforcing the idea that virality is truth. Your point will be undone by whatever other point is more viral. That is by design.
This is a chapter about politics. Before going any further, I have to say something obvious. This is a vital topic and I’ve seen a side of it you probably haven’t, so I want to tell you about that. At the same time, I’m a white techie, but in order to proceed I must talk about things I can’t know as well as I know my own world, like the black experience in America. I’m probably going to fall into the traps of whitesplaining, mansplaining, techsplaining, or other forms of ’splaining. Can we just stipulate that that’s true? I’m sure it is. Please take what you can use from me. I know I don’t
...more