Concept

SBERT-based Evaluation Metrics for Metaphor Generation

To automatically evaluate metaphor generation models using Sentence BERT (SBERT), sentence embeddings are generated for:

  1. The literal input LL
  2. The original gold metaphoric expression MM
  3. The generated output GG

Using these embeddings, the following metrics are calculated:

  • Distance from Gold Metaphor (dis): cos(M,G)\cos(M, G)
  • Relational distance (rel): cos(L,M)cos(L,G)\cos(L, M) - \cos(L, G)
  • Exact Match: The percentage of times the model produced the exact gold output.

0

1

Updated 2026-05-08

Tags

Natural language processing

Data Science