The difficulty in training a neural network is that the weight-update rule requires an estimate of the error at a neuron, and although it is straightforward to calculate the error for each neuron in the output layer of the network, it is difficult to calculate the error for the neurons in the earlier layers.
