Learn Before
Diversity Penalty
A diversity penalty is a mechanism designed to foster variety in generated text. It operates by penalizing similarity among different candidate outputs, or hypotheses, particularly within search algorithms like beam search. This encourages the model to explore and produce a more varied set of results.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Flexibility of the Penalty Function
Repetition Penalty
Length Penalty
Diversity Penalty
Constraint-based Penalty
Penalty Functions Based on Hidden States
A developer is building a system to generate empathetic and cautious responses for a customer service chatbot. To achieve this, they want to implement a penalty function that discourages the model from adopting an 'overly confident' or 'assertive' internal state during the text generation process, rather than simply penalizing specific words in the final output. Which of the following penalty function designs best aligns with this goal of operating on the model's internal representations?
Comparing Penalty Function Implementations
A team is developing a text generation model and is considering two different ways to penalize undesirable outputs. Match each proposed penalty mechanism with the implementation approach it represents.
Learn After
A language model using a search algorithm is prompted to generate three distinct completions for the sentence: 'The most rewarding part of learning a new skill is...'. Which of the following sets of completions most likely had a diversity penalty applied during the generation process?
Addressing Repetitive Model Outputs
Evaluating the Use of a Diversity Penalty in a Creative Writing Assistant