Based on the provided scenario, evaluate the likely flaw in this stopping rule and propose a specific, justifiable modification to improve the summary quality without reintroducing excessive repetition.

Google

To avoid generating redundant or incoherent text, a stopping criterion can be based on repetition. This involves implementing a detection module that terminates the generation process if the model starts repeating tokens or phrases more than a specified number of times.

Repetition Detection as a Stopping Criterion

An engineer is developing a system to generate long, creative stories. They notice that after a few paragraphs, the model often gets stuck, repeating the same descriptive sentence over and over again. The goal is to stop this looping behavior while preserving the story's creative flow as much as possible. Which of the following strategies would be the most appropriate to implement?

Tuning a Generation Stopping Rule

A developer is configuring a text generation system to stop when it detects repetition. They can set a 'repetition threshold,' which is the number of times a specific phrase can appear before generation is halted. Explain the potential negative consequences of setting this threshold too low (e.g., to 2) and the potential negative consequences of setting it too high (e.g., to 10).

Learn Before

Related