Learning Is Not A Linear Process

Despite what some people may believe, learning is rarely a linear process. Instead, it is often marked by changes in learning rate, along with significant plateaus after reaching important milestones.

Let’s start off with a physical example. Let’s say that you’re training to run five kilometres. If you’ve never run that far before, you’ll likely find the first days of training to be very hard. But once you get into the groove, you’ll also find that you improve fairly rapidly. But does that ra...