More on this book
Community
Kindle Notes & Highlights
by
Kai-Fu Lee
Read between
April 20 - June 13, 2021
Zhongguancun (pronounced “jong-gwan-soon”) neighborhood, an area often referred to as “the Silicon Valley of China.” Today, Zhongguancun is the beating heart of China’s AI movement.
For decades, the artificial intelligence revolution always looked to be five years away. But with the development of deep learning over the past few years, that revolution has finally arrived. It will usher in an era of massive productivity increases but also widespread disruptions in labor markets—and profound sociopsychological effects on people—as artificial intelligence takes over human jobs across all sorts of industries.
Those people who watched Ke’s frustration responded in kind. AlphaGo may have been the winner, but Ke became the people’s champion. In that connection—human beings giving and receiving love—I caught a glimpse of how humans will find work and meaning in the age of artificial intelligence.
Machine learning—the umbrella term for the field that includes deep learning—is a history-altering technology but one that is lucky to have survived a tumultuous half-century of research.
Back in the mid-1950s, the pioneers of artificial intelligence set themselves an impossibly lofty but well-defined mission: to recreate human intelligence in a machine. That striking combination of the clarity of the goal and the complexity of the task would draw in some of the greatest minds in the emerging field of computer science: Marvin Minsky, John McCarthy, and Herbert Simon.
“Artificial intelligence is the elucidation of the human learning process, the quantification of the human thinking process, the explication of human behavior, and the understanding of what makes intelligence possible. It is men’s final step to understand themselves, and I hope to take part in this new, but promising science.”
Researchers in the rule-based camp (also sometimes
called “symbolic systems” or “expert systems”) attempted to teach computers to think by encoding a series of logical rules: If X, then Y.
The “neural networks” camp,
Instead of trying to teach the computer the rules that had been mastered by a human brain, these practitioners tried to reconstruct the human brain itself.
They simply feed lots and lots of examples of a given phenomenon—pictures, chess games, sounds—into the neural networks and let the networks themselves identify patterns within the data. In other words, the less human interference, the better.
Differences between the two approaches can be seen in how they might approach a simple problem, identifying whether there is a cat in a picture. The rule-based approach would attempt to lay down “if-then” rules to help the program make a decision: “If there are two triangular shapes on top of a circular shape, then there is probably a cat in the picture.”
The neural network approach would instead feed the program millions of sample photos labeled “cat” or “no cat,” letting the program figure out for itself what features in the millions of ima...
This highlight has been truncated due to consecutive passage length restrictions.
In 1988, I used a technique akin to neural networks (Hidden Markov Models) to create Sphinx, the world’s first speaker-independent program for recognizing continuous
speech. That achievement landed me a profile in the New York Times. But it wasn’t enough to save neural networks from once again falling out of favor, as AI reentered a prolonged ice age for most of the 1990s.
Neural networks require large amounts of two things: computing power and data. The data “trains” the program to recognize patterns by giving it many examples, and the computing power lets the program
Deep learning’s big technical break finally arrived in the mid-2000s, when leading researcher Geoffrey Hinton discovered a way to efficiently train those new layers in neural networks. The result was like giving steroids to the old neural networks, multiplying
their power to perform tasks such as speech and object recognition. Soon, these juiced-up neural networks—now rebranded as “deep learning”—could outperform older models at a variety of tasks.
AI researchers to overlook this “fringe” group that claimed outstanding results. The turning point came in 2012, when a neural network built by Hinton’s team demolished the competi...
This highlight has been truncated due to consecutive passage length restrictions.
Doing this requires massive amounts of relevant data, a strong algorithm, a narrow domain, and a concrete goal.
Deep learning is what’s known as “narrow AI”—intelligence that takes data from one specific domain and applies it to optimizing one specific outcome. While impressive, it is still a far cry from “general AI,” the all-purpose technology that can do everything a human can.
deep learning precisely because its core power—its ability to recognize a pattern, optimize for a specific outcome, make a decision—can be applied to so many different kinds of everyday problems.
That global shift is the product of two transitions: from the age of discovery to the age of implementation, and from the age of expertise to the age of data.
Much of the difficult but abstract work of AI research has been done, and it’s now time for entrepreneurs to roll up their sleeves and get down to the dirty work of turning algorithms into sustainable businesses.
Today, successful AI algorithms need three things: big data, computing power, and the work of strong—but not necessarily elite—AI algorithm engineers.
Realizing the newfound promise of electrification a century ago required four key inputs: fossil fuels to generate it, entrepreneurs to build new businesses around it, electrical engineers to manipulate it, and a supportive government to develop the underlying public infrastructure.
Harnessing the power of AI today—the “electricity” of the twenty-first
first century—requires four analogous inputs: abundant data, hungry entrepreneurs, AI scientists, and an ...
This highlight has been truncated due to consecutive passage length restrictions.
now tilt the playing field toward China. They do this by minimizing China’s weaknesses and amplifying its strengths. Moving from discovery to implementation reduces one of China’s greatest weak points (outside-the-box approaches to research questions) and also leverages the country’s most significant strength: scrappy entrepreneurs with sharp instincts for building robust businesses.
China’s successful internet entrepreneurs have risen to where they are by conquering the most cutthroat competitive environment on the planet. They live in a world where
speed is essential, copying is an accepted practice, and competitors will stop at nothing to win a new market. Every day spent in China’s startup scene is a trial by fire, like a day spent as a gladiator in the Coliseum. The battles are life or death, and your opponents have no scruples.
That lack of competition can lead to a certain level of complacency, with entrepreneurs failing to explore all
the possible iterations of their first innovation.
But around 2013, China’s internet took a right turn. Rather than following in the footsteps or outright copying of American companies, Chinese entrepreneurs began developing products and services with simply no analog in Silicon Valley.
The Chinese internet had morphed into an alternate universe.
They represented a tidal wave of online-to-offline (O2O) startups that brought the convenience of e-commerce to bear on real-world services like restaurant food or manicures. Soon after that came the millions of brightly colored shared bikes that users could pick up or lock up anywhere just by scanning a bar code with their phones.
Tying all these services together was the rise of China’s super-app, WeChat, a kind of digital Swiss Army knife for modern life.
Putting all these pieces together—the dual transitions into the age of implementation and the age of data, China’s world-class entrepreneurs and proactive government—I
believe that China will soon match or even overtake the United States in developing and deploying artificial intelligence.
PricewaterhouseCoopers estimates AI deployment will add $15.7 trillion to global GDP by 2030. China is predicted to take home $7 trillion of that total, nearly double North America’s $3.7 trillion in gains. As the economic balance of power tilts in China’s favor, so too will political influence and “soft power,” the country’s cultural and ideological footprint around the globe.
As deep learning washes over the global economy, it will indeed wipe out billions of jobs up and down
the economic ladder: accountants, assembly line workers, warehouse operators, stock analysts, quality control inspectors, truckers, paralegals, and even radiologists, just to name a few.
Based on the current trends in technology advancement and adoption, I predict that within fifteen years, artificial intelligence will technically be able to replace around 40 to 50 percent of jobs in the United States.
Deep learning’s relationship with data fosters a virtuous circle for strengthening the best products and companies: more data leads to better products, which in
turn attract more users, who generate more data that further improves the product.
Instead of a dispersion of industry profits across different companies and regions, we will begin to see greater and greater concentration of these astronomical sums in the hands of a few, all while unemployment lines grow longer.
China and the United States are currently incubating the AI giants that will
dominate global markets and extract wealth from consumers around the globe.
AI-driven automation in factories will undercut the one economic advantage developing countries histor...
This highlight has been truncated due to consecutive passage length restrictions.
The AI world order will combine winner-take-all economics with an unprecedented concentration of wealth in the hands of a few companies in China and the United States. This, I believe, is the real underlying threat posed by artificial