Improving Generic Text Generation
Based on this scenario, critique the current search objective. Explain why simply finding the most probable sequence leads to this undesirable outcome and propose a general modification to the search objective to encourage more diverse and interesting headlines.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
MBR Decoding as an Alternative to MAP Decoding
Incorporating Penalty Terms for Controllable Decoding
Improving Generic Text Generation
A language model is tasked with generating creative story endings. Its current decoding process consistently produces endings that are grammatically perfect and logically sound, but are often predictable and repetitive (e.g., '...and they all lived happily ever after.'). Which of the following statements best analyzes why modifying the search objective could address this issue?
Diagnosing Repetitive Text Generation