Data Science for Business: What You Need to Know about Data Mining and Data-Analytic Thinking

by Foster Provost

The information gain of a feature depends on the set of instances against which it is evaluated, so the ranking of features for some internal node may not be the same as the global ranking.

Dependence of information gain on the feature