Based on how the synset lemmas are assessed, synset lemmas evaluation methods can be categorized as:

1)	Lemmas Validation Methods

2)	Lemmas Clustering Methods.



Synset Lemmas Evaluation Methods

Synset gloss contains background information about the synset. To evaluate it, Zhang et al. (2011) introduced a model that can measure semantic relatedness between gloss and synset, where they used the WordNet gloss and semantic relations as features that builds concept vectors. 

Synset Gloss Evaluation Methods

There are two types of synset relations corresponding evaluation methods:

1)	Implicit Relations

2)	Special Relations


Synset Relations Evaluation Methods

A good LSR depends on synset correctness and completeness, and also depends on the connectivity degree of the synset with other synsets in the semantic network. There are different evaluation methods for each part of the LSR:

1)	Synset Lemmas Evaluation Methods

2)	Synset Gloss Evaluation Methods

3)	Synset Relations Evaluation Methods


University of Notre Dame

Lexical Semantic Resources (LSRs) is a lexical database that organizes the relation between synsets via lexical and semantic relations. 

Lexical Semantic Resources (LSRs)

Khalilia, H., Freihat, A. A., & Giunchiglia, F. (2021). The Quality of Lexical Semantic Resources: A Survey. In Proceedings of The Fourth International Conference on Natural Language and Speech Processing (ICNLSP 2021) (pp. 117-129).

The Quality of Lexical Semantic Resources: A Survey

A synset consists of lemmas (a word in dictionary form), gloss (a sentance that describes the synset), and synset examples. For example, “person, individual, someone,
somebody, mortal, soul” are lemmas of a synset, and "a human being" is the gloss, and "there are too much for one person to do" is a synset example.

Synset

Lexicon quality challenges can be either a overload work or underload. Overload means it has some inappropriate senses, lemmas, or relations and produce overload components in LSR. Underwork means it has some missing senses, lemmas or connections. There are some specific challenges: 

1)	Polysemy

2)	Missing Senses, Lemmas and Relations


Learn Before

Related

Learn After