Kneser-Ney Smoothing / Absolute discounting

Kneser-Ney smoothing and absolute discounting are two techniques used in language modeling to address the problem of data sparsity, which occurs when the frequency of a particular n-gram in a training corpus is zero or very low. In this article, we will discuss the process of Kneser-Ney Smoothing and Absolute Discounting, its implementation, pros and cons, use cases, and real-time applications etc.

Tabel Of ContentAbsolute DiscountingKneser-Ney DiscountingNeed of Smoothing TechniquesMath Lo...