Learn Before
Analyzing Repetition Threshold Trade-offs
A developer is configuring a text generation system to stop when it detects repetition. They can set a 'repetition threshold,' which is the number of times a specific phrase can appear before generation is halted. Explain the potential negative consequences of setting this threshold too low (e.g., to 2) and the potential negative consequences of setting it too high (e.g., to 10).
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An engineer is developing a system to generate long, creative stories. They notice that after a few paragraphs, the model often gets stuck, repeating the same descriptive sentence over and over again. The goal is to stop this looping behavior while preserving the story's creative flow as much as possible. Which of the following strategies would be the most appropriate to implement?
Tuning a Generation Stopping Rule
Analyzing Repetition Threshold Trade-offs