Learn Before
Evaluating a Text Generation Strategy
A common text generation strategy involves sequentially selecting the single word with the highest probability at each step to form a sentence. Based on this description, identify one significant advantage and one significant disadvantage of this approach.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is generating a two-token sequence. At the first step, it assigns a probability of 0.5 to token 'A' and 0.4 to token 'B'. At the second step, if 'A' was chosen, the model assigns a probability of 0.5 to token 'C'. If 'B' was chosen, it assigns a probability of 0.9 to token 'D'. All other tokens have lower probabilities at each step. Based on this information, which statement accurately analyzes the outcome of a purely sequential, maximum-probability selection strategy?
Evaluating a Text Generation Strategy
Applying a Text Generation Strategy