Why Machines Learn: The Elegant Math Behind Modern AI

by Anil Ananthaswamy

In practice, the deltas are themselves multiplied by a small number called the learning rate, alpha, so that the weights and biases are adjusted by only a small fraction of the gradient.