More on this book
Community
Kindle Notes & Highlights
by
Kai-Fu Lee
Read between
April 15 - May 16, 2019
Today, Zhongguancun is the beating heart of China’s AI movement.
AlphaGo scored its first high-profile victory in March 2016 during a five-game series against the legendary Korean player Lee Sedol, winning four to one. While barely noticed by most Americans, the five games drew more than 280 million Chinese viewers.
By 2017, Chinese venture-capital investors had already responded to that call, pouring record sums into artificial intelligence startups and making up 48 percent of all AI venture funding globally, surpassing the United States for the first time.
Yes, the win was an impressive feat of engineering, but it was based on long-established technology that worked only on very constrained sets of issues.
some of the greatest minds in the emerging field of computer science: Marvin Minsky, John McCarthy, and Herbert Simon.
By the time I began my Ph.D., the field of artificial intelligence had forked into two camps: the “rule-based” approach and the “neural networks” approach.
Neural networks require large amounts of two things: computing power and data.
Deep learning’s big technical break finally arrived in the mid-2000s, when leading researcher Geoffrey Hinton discovered a way to efficiently train those new layers in neural networks. The result was like giving steroids to the old neural networks, multiplying their power to perform tasks such as speech and object recognition.
Soon, these juiced-up neural networks—now rebranded as “deep learning”—could outperform older models at a variety of tasks. But years of ingrained prejudice against the neural networks approach led many AI researchers to overlook this “fringe” group that claimed outstanding results. The turning point came in 2012, when a neural network built by Hinton’s team demolished the competition in an international computer vision contest.
Doing this requires massive amounts of relevant data, a strong algorithm, a narrow domain, and a concrete goal. If you’re short any one of these, things fall apart. Too little data? The algorithm doesn’t have enough examples to uncover meaningful correlations. Too broad a goal? The algorithm lacks clear benchmarks to shoot for in optimization.
Deep learning is what’s known as “narrow AI”—intelligence that takes data from one specific domain and applies it to optimizing one specific outcome. While impressive, it is still a far cry from “general AI,” the all-purpose technology that can do everything a human can.
Deep learning’s most natural application is in fields like insurance and making loans. Relevant data on borrowers is abundant (credit score, income, recent credit-card usage), and the goal...
This highlight has been truncated due to consecutive passage length restrictions.
That global shift is the product of two transitions: from the age of discovery to the age of implementation, and from the age of expertise to the age of data.
This is the age of implementation, and the companies that cash in on this time period will need talented entrepreneurs, engineers, and product managers.
Deep-learning pioneer Andrew Ng has compared AI to Thomas Edison’s harnessing of electricity: a breakthrough technology on its own, and one that once harnessed can be applied to revolutionizing dozens of different industries.
Much of the difficult but abstract work of AI research has been done, and it’s now time for entrepreneurs to roll up their sleeves and get down to the dirty work of turning algorithms into sustainable businesses.
Today, successful AI algorithms need three things: big data, computing power, and the work of strong—but not necessarily elite—AI algorithm engineers.
In deep learning, there’s no data like more data. The more examples of a given phenomenon a network is exposed to, the more accurately it can pick out patterns and identify things in the real world. Given much more data, an algorithm designed by a handful of mid-level AI engineers usually outperforms one designed by a world-class deep-learning researcher.
Harnessing the power of AI today—the “electricity” of the twenty-first century—requires four analogous inputs: abundant data, hungry entrepreneurs, AI scientists, and an AI-friendly policy environment.
China has already surpassed the United States in terms of sheer volume as the number one producer of data.
PricewaterhouseCoopers estimates AI deployment will add $15.7 trillion to global GDP by 2030. China is predicted to take home $7 trillion of that total, nearly double North America’s $3.7 trillion in gains. As the economic balance of power tilts in China’s favor, so too will political influence and “soft power,” the country’s cultural and ideological footprint around the globe.
Based on the current trends in technology advancement and adoption, I predict that within fifteen years, artificial intelligence will technically be able to replace around 40 to 50 percent of jobs in the United States.
Inequality will not be contained within national borders. China and the United States have already jumped out to an enormous lead over all other countries in artificial intelligence, setting the stage for a new kind of bipolar world order. Several other countries—the United Kingdom, France, and Canada, to name a few—have strong AI research labs staffed with great talent, but they lack the venture-capital ecosystem and large user bases to generate the data that will be key to the age of implementation. As AI companies in the United States and China accumulate more data and talent, the virtuous
...more
The AI world order will combine winner-take-all economics with an unprecedented concentration of wealth in the hands of a few companies in China and the United States. This, I believe, is the real underlying threat posed by artificial intelligence: tremendous social disorder and political collapse stemming from widespread unemployment and gaping inequality.
The dramatic transformation that deep learning promises to bring to the global economy won’t be delivered by isolated researchers producing novel academic results in the elite computer science labs of MIT or Stanford. Instead, it will be delivered by down-to-earth, profit-hungry entrepreneurs teaming up with AI experts to bring the transformative power of deep learning to bear on real-world industries.
Over the coming decade, China’s gladiator entrepreneurs will fan out across hundreds of industries, applying deep learning to any problem that shows the potential for profit.
In stark contrast, China’s startup culture is the yin to Silicon Valley’s yang: instead of being mission-driven, Chinese companies are first and foremost market-driven. Their ultimate goal is to make money, and they’re willing to create any product, adopt any model, or go into any business that will accomplish that objective. That mentality leads to incredible flexibility in business models and execution, a perfect distillation of the “lean startup” model often praised in Silicon Valley. It doesn’t matter where an idea came from or who came up with it. All that matters is whether you can
...more
Most Chinese tech entrepreneurs are at most one generation away from grinding poverty that stretches back centuries. Many are only children—products of the now-defunct “One Child Policy”—carrying on their backs the expectations of two parents and four grandparents who have invested all their hopes for a better life in this child. Growing up, their parents didn’t talk to them about changing the world. Rather, they talked about survival, about a responsibility to earn money so they can take care of their parents when their parents are too old to work in the fields. A college education was seen
...more
Combine these three currents—a cultural acceptance of copying, a scarcity mentality, and the willingness to dive into any promising new industry—and you have the psychological foundations of China’s internet ecosystem.
In Beijing, entrepreneurs often joke that Facebook is “the most Chinese company in Silicon Valley” for its willingness to copy from other startups and for Zuckerberg’s fiercely competitive streak.
When Sergei Brin and Larry Page founded Google in 1998, just 0.2 percent of the Chinese population was connected to the internet, compared with 30 percent in the United States.
fits-all product model. Companies like Google and Facebook are often loath to allow local changes to their core products or business models. They tend to believe in building one thing and building it well. It’s an approach that helped them rapidly sweep the globe in the early days of the internet, when most countries lagged so far behind in technology that they couldn’t offer any localized alternatives. But as technical know-how has diffused around the globe, it is becoming harder to force people of all countries and cultures into a cookie-cutter mold that was often built in America for
...more
In a market where copying was the norm, these entrepreneurs were forced to work harder and execute better than their opponents. Silicon Valley prides itself on its aversion to copying, but this often leads to complacency. The first mover is simply ceded a new market because others don’t want to be seen as unoriginal. Chinese entrepreneurs have no such luxury. If they succeed in building a product that people want, they don’t get to declare victory. They have to declare war.
If artificial intelligence is the new electricity, big data is the oil that powers the generators. And as China’s vibrant and unique internet ecosystem took off after 2012, it turned into the world’s top producer of this petroleum for the age of artificial intelligence.
The Chinese tech companies that ruled this world had no obvious corollaries in Silicon Valley. Simple shorthand like “the Amazon of China” or “the Facebook of China” no longer made sense when describing apps like WeChat—the dominant social app in China, but one that evolved into a “digital Swiss Army knife” capable of letting people pay at the grocery store, order a hot meal, and book a doctor’s visit.
Algorithms tuned by an average engineer can outperform those built by the world’s leading experts if the average engineer has access to far more data.
One woman on the country’s most popular dating show captured the materialism of the moment when she rejected a poor suitor by saying, “I’d rather cry in the back of a BMW than smile on the back of a bicycle.”
creating an AI superpower for the twenty-first century requires four main building blocks: abundant data, tenacious entrepreneurs, well-trained AI scientists, and a supportive policy environment.
As artificial intelligence filters into the broader economy, this era will reward the quantity of solid AI engineers over the quality of elite researchers.
While America still dominates when it comes to superstar researchers, Chinese companies and research institutions have filled their ranks with the kind of well-trained engineers that can power this era of AI deployment.
the so-called Seven Giants of the AI age, which include Google, Facebook, Amazon, Microsoft, Baidu, Alibaba, and Tencent.
Often, once a fundamental breakthrough has been achieved, the center of gravity quickly shifts from a handful of elite researchers to an army of tinkerers—engineers with just enough expertise to apply the technology to different problems. This is particularly true when the payoff of a breakthrough is diffused throughout society rather than concentrated in a few labs or weapons systems.
A constant stream of headlines about the latest task tackled by AI gives us the mistaken sense that we are living through an age of discovery, a time when the Enrico Fermis of the world determine the balance of power. In reality, we are witnessing the application of one fundamental breakthrough—deep learning and related techniques—to many different problems. That’s a process that requires well-trained AI scientists, the tinkerers of this age. Today, those tinkerers are putting AI’s superhuman powers of pattern recognition to use making loans, driving cars, translating text, playing Go, and
...more
Deep-learning pioneers like Geoffrey Hinton, Yann LeCun, and Yoshua Bengio—the Enrico Fermis of AI—continue to push the boundaries of artificial intelligence. And they may yet produce another game-changing breakthrough, one that scrambles the global technological pecking order. But in the meantime, the real action today is with the tinkerers.
And for this technological revolution, the tinkerers have an added advantage: real-time access to the work of leading pioneers. During the Industrial Revolution, national borders and language barriers meant that new industrial breakthroughs remained bottled up in their country of origin, England. America’s cultural proximity and loose intellectual property laws helped it pilfer some key inventions, but there remained a substantial lag between the innovator and the imitator.
When asked how far China lags behind Silicon Valley in artificial intelligence research, some Chinese entrepreneurs jokingly answer “sixteen hours”—the time difference between California and Beijing. America may be home to the top researchers, but much of their work and insight is instantaneously available to anyone with an internet connection and a grounding in AI fundamentals.
In many physical sciences, experiments cannot be fully replicated from one lab to the next—minute variations in technique or environment can greatly affect results. But AI experiments are perfectly replicable, and algorithms are directly comparable. They simply require those algorithms to be trained and tested on identical data sets.
But given the rapid pace of improvements, many researchers fear that if they wait to publish in a journal, their record will already have been eclipsed and their moment at the cutting edge will go undocumented. So instead of sitting on that research, they opt for instant publication on websites like www.arxiv.org, an online repository of scientific papers. The site lets researchers instantly time-stamp their research, planting a stake in the ground to mark the “when and what” of their algorithmic achievements.
That ranking of the one hundred most-cited research institutions on AI from 2012 to 2016 showed China ranking second only to the United States. Among the elite institutions, Tsinghua University even outnumbered places like Stanford University in total AI citations.
when Google’s DeepMind built AlphaGo Zero—the self-taught successor to AlphaGo—they used ResNet as one of its core technological building blocks.