Learn Before
Impact of Selection Parameter on Text Generation
A developer is tuning a language model for creative story writing. They are testing two configurations for the word selection process:
- Configuration X: At each step, the model keeps only the single most probable next word.
- Configuration Y: At each step, the model keeps the top 10 most probable next words.
Evaluate which configuration is more likely to produce a creative and less repetitive story. Justify your answer by explaining the trade-offs involved in the selection process.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Example of K-Best Selection with a Beam Width of 3
Ranking Stage in Beam Search
Expansion Stage in K-Best Selection
A language model generates the following potential next words and their corresponding probabilities: 'house' (0.25), 'car' (0.40), 'boat' (0.15), 'plane' (0.18), and 'train' (0.02). If a selection process is used to keep only the top 3 most probable words, which set of words will be chosen?
A language model is generating the next word in a sentence. Arrange the following actions into the correct sequence for selecting the most promising candidates.
Ranking Stage in K-Best Selection
Output Stage in K-Best Selection
Impact of Selection Parameter on Text Generation