Learn Before
Modifying Search Algorithms for Enhanced Sampling
The search algorithms used by Large Language Models can be modified to support more powerful sampling methods. This enhancement allows for the exploration of a more extensive and diverse range of high-quality hypotheses, leading to better and more varied outputs.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Using Beam Search to Generate Multiple Outputs
Modifying Search Algorithms for Enhanced Sampling
Adjusting Temperature for Output Diversity
A developer is using a text-generation model to brainstorm a list of potential taglines for a new product. They provide a single, well-crafted prompt but find that the model consistently produces the same tagline. To generate a variety of different, high-quality taglines from this one prompt, which approach directly leverages the model's ability to consider multiple potential outcomes?
Optimizing a Content Generation System
Generating Creative Variations
Example of Generating Multiple Responses via LLM Sampling
Learn After
Optimizing a Language Model for Creative Content Generation
A developer is using a large language model to generate creative story prompts. They find that while the generated prompts are grammatically correct and coherent, they are also highly repetitive and predictable, often revolving around the same few themes. To encourage the model to produce a wider range of more original ideas, which modification to the underlying search process would be most effective?
Balancing Exploration and Exploitation in Text Generation