More on this book
Community
Kindle Notes & Highlights
by
Jaron Lanier
Read between
August 4 - August 9, 2023
Now everyone who is on social media is getting individualized, continuously adjusted stimuli, without a break, so long as they use their smartphones. What might once have been called advertising must now be understood as continuous behavior modification on a titanic scale.
When people get a flattering response in exchange for posting something on social media, they get in the habit of posting more. That sounds innocent enough, but it can be the first stage of an addiction that becomes a problem both for individuals and society. Even though Silicon Valley types have a sanitized name for this phase, “engagement,” we fear it enough to keep our own children away from it. Many of the Silicon Valley kids I know attend Waldorf schools, which generally forbid electronics.
Social media algorithms are usually “adaptive,” which means they constantly make small changes to themselves in order to try to get better results; “better” in this case meaning more engaging and therefore more profitable. A little randomness is always present in this type of algorithm.
When an algorithm is feeding experiences to a person, it turns out that the randomness that lubricates algorithmic adaptation can also feed human addiction. The algorithm is trying to capture the perfect parameters for manipulating a brain, while the brain, in order to seek out deeper meaning, is changing in response to the algorithm’s experiments; it’s a cat-and-mouse game based on pure math. Because the stimuli from the algorithm don’t mean anything, because they genuinely are random, the brain isn’t adapting to anything real, but to a fiction. That process—of becoming hooked on an elusive
...more
Social networks bring in another dimension of stimuli: social pressure. People are keenly sensitive to social status, judgment, and competition. Unlike most animals, people are not only born absolutely helpless, but also remain so for years. We only survive by getting along with family members and others. Social concerns are not optional features of the human brain. They are primal. The power of what other people think has proven to be intense enough to modify the behavior of subjects participating in famous studies like the Milgram Experiment and the Stanford Prison Experiment. Normal,
...more
For instance, when we are afraid that we might not be considered cool, attractive, or high-status, we don’t feel good. That fear is a profound emotion. It hurts.9 Everybody suffers from social anxiety from time to time, and every child has encountered a bully who used social anxiety as a weapon of torture, probably because behaving like a bully lessened the chances that the bully might become a target. That’s why people, even those who would normally be decent, tend to pile on to a victim of social anxiety torture. They’re so afraid of the very real pain that social anxiety brings that they
...more
Negative emotions such as fear and anger well up more easily and dwell in us longer than positive ones. It takes longer to build trust than to lose trust. Fight-or-flight responses occur in seconds, while it can take hours to relax. This is true in real life, but it is even more true in the flattened light of algorithms.
The prime directive to be engaging reinforces itself, and no one even notices that negative emotions are being amplified more than positive ones. Engagement is not meant to serve any particular purpose other than its own enhancement, and yet the result is an unnatural global amplification of the “easy” emotions, which happen to be the negative ones.
Back in its earliest days, online advertising really was just advertising. But before long, advances in computing happened to coincide with ridiculously perverse financial incentives, as will be explained in the next argument. What started as advertising morphed into what would better be called “empires of behavior modification for rent.” That transformation has often attracted new kinds of customers/manipulators, and they aren’t pretty.
Social media is biased, not to the Left or the Right, but downward. The relative ease of using negative emotions for the purposes of addiction and manipulation makes it relatively easier to achieve undignified results. An unfortunate combination of biology and math favors degradation of the human world. Information warfare units sway elections, hate groups recruit, and nihilists get amazing bang for the buck when they try to bring society down.
The unfortunate result is that once an app starts to work, everyone is stuck with it. It’s hard to quit a particular social network and go to a different one, because everyone you know is already on the first one. It’s effectively impossible for everyone in a society to back up all their data, move simultaneously, and restore their memories at the same time. Effects of this kind are called network effects or lock-ins. They’re hard to avoid on digital networks.
One of the main reasons to delete your social media accounts is that there isn’t a real choice to move to different social media accounts. Quitting entirely is the only option for change. If you don’t quit, you are not creating the space in which Silicon Valley can act to improve itself.
Addiction gradually turns you into a zombie. Zombies don’t have free will. Once again, this result isn’t total but statistical. You become more like a zombie, more of the time, than you otherwise would be. There’s no need to believe in some myth of perfect people who are completely free of addictions. They don’t exist. You’re not going to become perfect or perfectly free, no matter how many self-help books you read or how many addictive services you quit. There’s no such thing as perfectly free will. Our brains are constantly changing their ways to adapt to a changing environment. It’s hard
...more
To free yourself, to be more authentic, to be less addicted, to be less manipulated, to be less paranoid … for all these marvelous reasons, delete your accounts.
Some have compared social media to the tobacco industry,5 but I will not. The better analogy is paint that contains lead. When it became undeniable that lead was harmful, no one declared that houses should never be painted again. Instead, after pressure and legislation, lead-free paints became the new standard.6 Smart people simply waited to buy paint until there was a safe version on sale. Similarly, smart people should delete their accounts until nontoxic varieties are available.
THE PARTS THAT MAKE UP THE BUMMER MACHINE BUMMER is a machine with six moving parts. Here’s a mnemonic for the six components of the BUMMER machine, in case you ever have to remember them for a test: A is for Attention Acquisition leading to Asshole supremacy B is for Butting into everyone’s lives C is for Cramming content down people’s throats D is for Directing people’s behaviors in the sneakiest way possible E is for Earning money from letting the worst assholes secretly screw with everyone else F is for Fake mobs and Faker society
Ordinary people are brought together in a setting in which the main—or often the only—reward that’s available is attention. They can’t reasonably expect to earn money, for instance. Ordinary users can gain only fake power and wealth, not real power or wealth. So mind games become dominant. With nothing else to seek but attention, ordinary people tend to become assholes, because the biggest assholes get the most attention.
To review: Customized feeds become optimized to “engage” each user, often with emotionally potent cues, leading to addiction. People don’t realize how they are being manipulated. The default purpose of manipulation is to get people more and more glued in, and to get them to spend more and more time in the system.7 But other purposes for manipulation are also tested. For instance, if you’re reading on a device, your reading behaviors will be correlated with those of multitudes of other people. If someone who has a reading pattern similar to yours bought something after it was pitched in a
...more
SOCIAL MEDIA IS MAKING YOU INTO AN ASSHOLE Let me rephrase this argument’s title. I don’t know you. I’m not saying that you personally are definitely turning into an asshole, but many people are, yet they seem to only see that many other people are. I’ve seen myself start turning into an asshole online, and it was scary and depressing. So what I should really say is something like “You’re vulnerable to gradually turning into an asshole, or statistically you might very well be turning into an asshole. So, no offense, but please take the possibility seriously.”
Addicts also become aggressive, though they feel they are acting out of necessity. The choice is to victimize or be a victim. Even successful and pleasant BUMMER addicts, like top social media influencers, have reported that they must not be too nice to others, for that shows weakness1 in a highly competitive fishbowl. One must be followed more than one follows, for appearances’ sake.
Briefly I was one of the HuffPost’s top bloggers, always on the front page. But I found myself falling into that old problem again whenever I read the comments, and I could not get myself to ignore them. I would feel this weird low-level boiling rage inside me. Or I’d feel this absurd glow when people liked what I wrote, even if what they said didn’t indicate that they had paid much attention to it. Comment authors were mostly seeking attention for themselves.
After a short while, I noticed that I’d write things I didn’t even believe in order to get a rise out of readers. I wrote stuff that I knew people wanted to hear, or the opposite, because I knew it would be inflammatory. Oh my God! I was back in that same place, becoming an asshole because of something about this stupid technology! I quit—again. Of all the ten arguments in this book, this is the one that really gets to me viscerally. I don’t want to be an asshole. Or a fake-nice person. I want to be authentically nice, and certain online designs seem to fight against that with magical force.
...more
BUMMER platform experiences ricochet between two extremes. Either there’s a total shitstorm of assholes (that’s not a mixed metaphor, right?) or everyone is super careful and artificially nice. The biggest assholes get the most attention, however, and they often end up giving a platform its flavor. Even if there are corners of the platform where not everyone is an asshole all the time, those corners feel penned in, because the assholes are waiting just outside. It’s part of how BUMMER Component A pushes tribalism.
Each of us has an inner troll. In the early days, before everyone was doing it, the air was clearer and it was easier to notice how bizarre it is when your inner troll starts talking. It’s like an ugly alien living inside you that you long ago forgot about. Don’t let your inner troll take control! If it happens when you’re in a particular situation, avoid that situation! It doesn’t matter if it’s an online platform, a relationship, or a job. Your character is like your health, more valuable than anything you can buy. Don’t throw it away.
When you are a solitary wolf, you are forced to get directly in touch with the larger reality that doesn’t care about what a society thinks. You must find water and shelter, or you will perish. You have to scavenge and hunt for yourself. Your personality shifts; you must solve problems on the basis of evidence you gather on your own, instead of by paying attention to group perception. You take on the qualities of a scientist or an artist.
In the meantime, there is something you can do personally. If, when you participate in online platforms, you notice a nasty thing inside yourself, an insecurity, a sense of low self-esteem, a yearning to lash out, to swat someone down, then leave that platform. Simple. There is a spotlight on online bullying, as there should be, and you might have experienced being bullied online. Many, many people have. But I am also asking you to notice, within your own mind, in genuine secrecy—don’t share this—if you are feeling the temptation to strike out at someone else online. Maybe that other person
...more