Learn Before
Repetition Detection as a Stopping Criterion
To avoid generating redundant or incoherent text, a stopping criterion can be based on repetition. This involves implementing a detection module that terminates the generation process if the model starts repeating tokens or phrases more than a specified number of times.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Probability Threshold as a Stopping Criterion
Repetition Detection as a Stopping Criterion
An engineer is developing a chatbot designed for creative storytelling. To ensure the stories don't become nonsensical or repetitive, the engineer needs to implement a rule to stop the text generation process. Which of the following rules is based on monitoring the dynamic behavior of the model's output during generation?
Debugging a Text Generation Loop
Evaluating Stopping Criteria for Different Generation Tasks
Learn After
An engineer is developing a system to generate long, creative stories. They notice that after a few paragraphs, the model often gets stuck, repeating the same descriptive sentence over and over again. The goal is to stop this looping behavior while preserving the story's creative flow as much as possible. Which of the following strategies would be the most appropriate to implement?
Tuning a Generation Stopping Rule
Analyzing Repetition Threshold Trade-offs