Learn Before
Formula

Laplace (Add-One) Smoothing Formulas

Laplace smoothing applied to the unigram probability of word wiw_i with count cic_i, which is normalized by the total number of word tokens NN and the number of words in the vocabulary VV: PLaplace(wi)=ci+1N+VP_{Laplace}(w_i) = \frac{c_i+1}{N+V} It is more convenient to define an adjusted count cic_i^*, and turn it into a probability PiP_i^* by normalizing by NN: ci=(ci+1)NN+Vc_i^* = (c_i + 1)\frac{N}{N+V} The add-one smoothed bigram probability and adjusted count are given by: PLaplace(wnwn1)=C(wn1wn)+1w(C(wn1wn)+1)=C(wn1wn)+1C(wn1)+VP^*_{Laplace}(w_n|w_{n-1}) = \frac{C(w_{n-1}w_n) + 1}{\sum_w (C(w_{n-1}w_n) + 1)} = \frac{C(w_{n-1}w_n) + 1}{C(w_{n-1}) + V} c(wn1wn)=(C(wn1wn)+1)×C(wn1)C(wn1)+Vc^*(w_{n-1}w_n) = \frac{(C(w_{n-1}w_n) + 1) \times C(w_{n-1})}{C(w_{n-1}) + V}

0

1

Updated 2026-06-21

Tags

Data Science