Humans don’t learn a native language from grammar books, after all. The trajectory so far has been as follows: We create a machine that follows strict rules in order to imitate human performance. Its performance is poor and artificial. With generations of optimization and speed gains, performance improves. The next jump occurs when the programmers loosen the rules and allow the machine to figure out more things on its own, and to shape or even ignore the old rules. To become good at anything you have to know how to apply basic principles. To become great at it, you have to know when to violate
...more
