Successive layers correspond to more abstract representations until we get to the final layer where the outputs are learned in terms of these most abstract concepts. We saw an example of this in the convolutional neural network where starting from pixels, we get to edges, and then to corners, and so on, until we get to a digit.
