The Art of Statistics: Learning from Data

by David Spiegelhalter

This is known as over-fitting, and is one of the most vital topics in algorithm construction. By making an algorithm too complex, we essentially start fitting the noise rather than the signal.