Constrained Text Generation and Search Strategy
A language model is tasked with generating a sentence that must end with a specific, predetermined word (e.g., '...spectroscopy.'). A simple, step-by-step (greedy) generation process often fails at this task, producing a grammatically correct but non-compliant sentence. Analyze why expanding the search space is particularly beneficial for successfully completing this type of constrained task.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Consider two text generation tasks for a language model. Task A involves summarizing a factual news article about a recent election. Task B involves generating a short, rhyming poem about the four seasons. In which task would significantly expanding the search space during the generation process be more crucial for achieving a high-quality result, and why?
Diagnosing Suboptimal Creative Generation
Constrained Text Generation and Search Strategy