Critique of the Fertility Modeling Analogy
In some text generation tasks, a model must replace a single placeholder token with a sequence of multiple words of unknown length. This challenge is often compared to 'fertility modeling' from traditional machine translation, where a model must decide how many words in a target language correspond to a single word in the source language. Critically evaluate this analogy. In your response, discuss at least one major strength and one significant limitation of this comparison.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Conceptual Parallel in Generative Modeling
In generative language models, the challenge of predicting the length of a masked span is often compared to the concept of 'fertility' from statistical machine translation. Which of the following statements most accurately analyzes the relationship between these two concepts?
Critique of the Fertility Modeling Analogy