Algorithms to Live By: The Computer Science of Human Decisions

by Brian Christian

Imposing penalties on the ultimate complexity of a model is not the only way to alleviate overfitting, however. You can also nudge a model toward simplicity by controlling the speed with which you allow it to adapt to incoming data.