PCFGs for Language Modeling
Next word prediction with PCFG
P(wi∣w1,w2,...,wi−1)=P(w1,w2,...,wi−1,wi)P(w1,w2,...,wi−1)P(w_i | w_1, w_2, ..., w_{i-1}) = \frac{P(w_1, w_2, ..., w_{i-1}, w_i)}{P(w_1, w_2, ..., w_{i-1})}P(wi∣w1,w2,...,wi−1)=P(w1,w2,...,wi−1)P(w1,w2,...,wi−1,wi)
0
1
Share
Contributors are:
Who are from:
References
Speech and Language Processing (3rd ed. draft)
Tags
Data Science
Probability of an unambiguous sentence
Probability of an ambiguous sentence