Learn Before
  • Probabilistic CKY Algorithm

Treebank

A treebank is a corpus of already-parsed sentences, which helps to learn probabilities for the rules of a grammar. Using a treebank, we can use the below formula to compute the probability of each expansion of a non-terminal by counting the number of times that expansion occurs and then normalizing. Without a treebank, we would need to account for any ambiguities, and then parse.

Image 0

0

1

3 years ago

Tags

Deep Learning

Data Science

Related
  • Treebank

Learn After
  • Inside-Outside Algorithm