Data Science for Business: What You Need to Know about Data Mining and Data-Analytic Thinking

by Foster Provost

basic measure of attribute information is called information gain, which is based on a purity measure called entropy; another is variance reduction.

Basic measures of attribute information: information gain + variance reduction