The Inevitable: Understanding the 12 Technological Forces That Will Shape Our Future

by Kevin Kelly

One of the early stage AI companies Google purchased is DeepMind, based in London. In 2015 researchers at DeepMind published a paper in Nature describing how they taught an AI to learn to play 1980s-era arcade video games, like Video Pinball. They did not teach it how to play the games, but how to learn to play the games—a profound difference. They simply turned their cloud-based AI loose on an Atari game such as Breakout, a variant of Pong, and it learned on its own how to keep increasing its score. A video of the AI’s progress is stunning. At first, the AI plays nearly randomly, but it gradually improves. After a half hour it misses only once every four times. By its 300th game, an hour into it, it never misses. It keeps learning so fast that in the second hour it figures out a loophole in the Breakout game that none of the millions of previous human players had discovered. This hack allowed it to win by tunneling around a wall in a way that even the game’s creators had never imagined. At the end of several hours of first playing a game, with no coaching from the DeepMind creators, the algorithms, called deep reinforcement machine learning, could beat humans in half of the 49 Atari video games they mastered. AIs like this one are getting smarter every month, unlike human players.