Learn Before
Analyzing Parameter Impact on Text Generation
A developer is configuring a text generation model that uses a search algorithm to produce output. They must choose a value for a parameter that determines how many of the most likely next-word sequences are kept for consideration at each step. Compare the likely impact of setting this parameter to a very low value (e.g., 2) versus a very high value (e.g., 20) on both the computational resources required and the quality of the final generated text.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Balancing Efficiency and Accuracy with Beam Width (K)
An engineer is using a text generation model that employs a search algorithm where a parameter,
K, determines the number of top candidate sequences kept at each step. The engineer observes that withK=1, the generated text is often repetitive and predictable. To improve the diversity and potential quality of the output, which of the following adjustments toKis the most logical next step?Analyzing Generation Algorithm Performance
Analyzing Parameter Impact on Text Generation