Learn Before
Applying a Text Generation Strategy
A language model is generating text starting with the prompt 'The ocean is'. Given the model's predicted probabilities for the next two words as detailed below, determine the exact two-word sequence that will be generated if the model exclusively selects the single most likely token at each step. Explain your reasoning for each selection.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is generating a two-token sequence. At the first step, it assigns a probability of 0.5 to token 'A' and 0.4 to token 'B'. At the second step, if 'A' was chosen, the model assigns a probability of 0.5 to token 'C'. If 'B' was chosen, it assigns a probability of 0.9 to token 'D'. All other tokens have lower probabilities at each step. Based on this information, which statement accurately analyzes the outcome of a purely sequential, maximum-probability selection strategy?
Evaluating a Text Generation Strategy
Applying a Text Generation Strategy