Python Machine Learning: Machine Learning and Deep Learning with Python, scikit-learn, and TensorFlow

by Sebastian Raschka

the information gain is simply the difference between the impurity of the parent node and the sum of the child node impurities — the lower the impurity of the child nodes, the larger the information gain.