Learn Before
Concept
Evaluation of Dependency Parsers
As with phrase structure-based parsing, the evaluation of dependency parsers proceeds by measuring how well they work on a test set. An obvious metric would be exact match (EM) — how many sentences are parsed correctly; however, most of the times this metric is too pessimistic. Alternative methods are:
- Labelled attachment score (LAS), which looks at the proper assignment of a word to its head along with the correct dependency relation.
- Unlabelled attachment score (UAS), which looks at the correctness of the assigned head, ignoring the dependency relation.
- Label accuracy score (LS), which looks at tokens with correct labels, ignoring where the relations are coming from.
0
0
Updated 2022-01-16
Tags
Data Science
Related
Example of typed dependency structure
Advantage of Dependency Parsing
Selected dependency relations from the Universal Dependency set
Examples of core Universal Dependency relations
Simple application of UD scheme on the sentence
Oracle
Treebanks
Dependency Formalisms
Graph-Based
Evaluation of Dependency Parsers