Consistent testing and iteration are critical to AI systems that learn and improve over time. The vast majority of tests will fail initially. When IBM Watson collaborated with Toyota to create advertising copy for the new Mirai car model, the first versions of algorithmically generated texts were incoherent. After a couple months of tuning, the AI system learned to write thousands of useful ads.
