More on this book
Community
Kindle Notes & Highlights
by
Jaron Lanier
Read between
January 8 - January 9, 2023
What might once have been called advertising must now be understood as continuous behavior modification on a titanic scale.
Here’s Sean Parker, the first president of Facebook: We need to sort of give you a little dopamine hit every once in a while, because someone liked or commented on a photo or a post or whatever.… It’s a social-validation feedback loop … exactly the kind of thing that a hacker like myself would come up with, because you’re exploiting a vulnerability in human psychology.… The inventors, creators—it’s me, it’s Mark [Zuckerberg], it’s Kevin Systrom on Instagram, it’s all of these people—understood this consciously. And we did it anyway … it literally changes your relationship with society, with
...more
Here’s Chamath Palihapitiya, former vice president of user growth at Facebook: The short-term, dopamine-driven feedback loops we’ve created are destroying how society works.… No civil discourse, no cooperation; misinformation, mistruth. And it’s not an American problem—this is not about Russian ads. This is a global problem.… I feel tremendous guilt. I think we all knew in the back of our minds—even though we feigned this whole line of, like, there probably aren’t any bad unintended consequences. I think in the back, deep, deep recesses of, we kind of knew something bad could happen.… So we
...more
The core process that allows social media to make money and that also does the damage to society is behavior modification. Behavior modification entails methodical techniques that change behavioral patterns in animals and people. It can be used to treat addictions, but it can also be used to create them.
Using symbols instead of real rewards has become an essential trick in the behavior modification toolbox.
Whether or not positive feedback might in theory be more effective in certain cases, negative feedback turns out to be the bargain feedback, the best choice for business, so it appears more often in social media.
Negative emotions such as fear and anger well up more easily and dwell in us longer than positive ones. It takes longer to build trust than to lose trust. Fight-or-flight responses occur in seconds, while it can take hours to relax.
The prime directive to be engaging reinforces itself, and no one even notices that negative emotions are being amplified more than positive ones. Engagement is not meant to serve any particular purpose other than its own enhancement, and yet the result is an unnatural global amplification of the “easy” emotions, which happen to be the negative ones.
In the bigger picture, in which people must do more than conform in order for our species to thrive, behaviorism is an inadequate way to think about society. If you want to motivate high value and creative outcomes, as opposed to undertaking rote training, then reward and punishment aren’t the right tools at all.
Instead of applying the simple mechanisms of behaviorism, we need to think about people in more creative ways, if we expect them to be creative. We need to foster joy, intellectual challenge, individuality, curiosity, and other qualities that don’t fit into a tidy chart.
Social media is biased, not to the Left or the Right, but downward. The relative ease of using negative emotions for the purposes of addiction and manipulation makes it relatively easier to achieve undignified results. An unfortunate combination of biology and math favors degradation of the human world. Information warfare units sway elections, hate groups recruit, and nihilists get amazing bang for the buck when they try to bring society down.
One of the main reasons to delete your social media accounts is that there isn’t a real choice to move to different social media accounts. Quitting entirely is the only option for change. If you don’t quit, you are not creating the space in which Silicon Valley can act to improve itself.
So the problem isn’t behavior modification in itself. The problem is relentless, robotic, ultimately meaningless behavior modification in the service of unseen manipulators and uncaring algorithms.
Hypnosis might be therapeutic so long as you trust your hypnotist, but who would trust a hypnotist who is working for unknown third parties? Who? Apparently billions of people.
To free yourself, to be more authentic, to be less addicted, to be less manipulated, to be less paranoid … for all these marvelous reasons, delete your accounts.
“Behaviors of Users Modified, and Made into an Empire for Rent”? BUMMER.
Now the real news is called “fake news,” because by the standards of BUMMER, what is real is fake; in BUMMER, reality has been replaced by stupid numbers.