Evaluating the novelty of an expression is often easier than assessing its creativity or originality. In manual evaluation, a high score is assigned if the evaluator has never encountered the expression, while a low score is given to conventional, widely used expressions. This process can be automated by measuring novelty based on the frequency of the expression's occurrences in a corpus.

University of Michigan - Ann Arbor

Google

MIPVU is a systematic procedure for determining whether a word is metaphor-related in context. Annotators first determine the contextual meaning of a target word. They then consult a dictionary to search for a more basic meaning than the contextual meaning. If a basic meaning exists and the contextual meaning differs from it, but can still be understood in comparison to it, the word is judged as metaphor-related.

MIPVU Method for Judging Metaphor-Related Words

Metaphoricity: We collect metaphoricity scores by asking simple questions of crowdworkers. After that, we check if the results are reliable by using MIPVU.

Metaphoricity

Overall evaluation: While it can be defined in many ways, for simplicity, we calculate it by just adding the three metrics.

Learn Before

Related