KL Divergence

In this article , one will learn about basic idea behind Kullback-Leibler Divergence (KL Divergence), how and where it is used.

TABLE CONTENTSIntroductionHow KL-DIVERGENCE is defined?Why it is not used to measure distance?IllustrationsUses of KL-DivergenceKL-Divergence vs Cross EntropyConclusionINTRODUCTION

This article will give a clear insight into Kullback-Leibler Divergence(KL Divergence) . KL-Divergence is something that allows us to measure how far two distrib...