Decision Trees and Random Forests: A Visual Introduction For Beginners: A Simple Guide to Machine Learning with Decision Trees

by Chris Smith

"If a particular node is split, does it increase or decrease entropy?" To answer this question, the formula measures the difference in entropy before the split and after the split, and then analyzes the result.