Entropy is a mathematical term that explains the measure of variance in the data among different classes. In simple terms, we want the data at each layer to be more homogenous than at the last. We thus want to pick a “greedy” algorithm that can reduce the level of entropy at each layer of the tree.
