Delta Rule in Neural Network

We shall be discussing Delta rule in neural networks that is used to updated weights during training a Neural Network.

Table of Contents:

IntroductionMathematical DefinitionApplicationDerivation of delta ruleIntroduction

The delta rule is a formula for updating the weights of a neural network during training. It is considered a special case of the backpropagation algorithm. The delta rule is in fact a gradient descent learning rule.
Recall that the process of training a neural network inv...