Data Science for Business: What You Need to Know about Data Mining and Data-Analytic Thinking

by Foster Provost

The sum of the squares of the weights gives a large penalty when weights have large absolute values. If we incorporate the L2-norm penalty into standard least-squares linear regression, we get the statistical procedure called ridge regression.