Why Machines Learn: The Elegant Math Behind Modern AI

by Anil Ananthaswamy

The gradient points away from the minimum. So, to go down toward the minimum, you must take a small step in the opposite direction or follow the negative of the gradient.