Learn Before
Code

Interpolated Absolute Discounting Applied to Bigrams

PAbsoluteDiscounting(wiwi1)=C(wi1wi)dvC(wi1v)+λ(wi1)P(wi)P_{AbsoluteDiscounting}(w_i|w_{i-1}) = \frac{C(w_{i-1}w_i)-d}{\sum_vC(w_{i-1}v)}+\lambda(w_{i-1})P(w_i)

Where first term is the discounted bigram, and the second term is the unigram with an interpolation weight λ.

0

1

Updated 2021-09-18

Tags

Data Science