Learn Before
Implicit Search Scaling in Search Procedures
Search scaling is a broad concept that is often implicitly incorporated into the design of various search procedures. These procedures exploit search structures, heuristics, and model uncertainty to find better outputs. While many of these methods were not originally developed with the primary goal of scaling, they inherently leverage search scaling principles by expanding the output length or the space of candidate sequences considered.
0
1
Tags
Foundations of Large Language Models
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Benefit of Search Space Expansion in Complex Decoding Tasks
Computational Costs of Search Scaling
Scaling Output Length in Search Scaling
Scaling the Search Space in Search Scaling
An engineer is using a fixed, pre-trained language model to generate a complex travel itinerary. The initial outputs are often functional but fail to find the most optimal route. The engineer cannot alter the model's internal parameters. Which of the following adjustments to the generation process is a direct application of search scaling to find a better itinerary?
Applying Search Scaling Strategies
Analyzing Trade-offs in Inference-Time Search Configuration
Implicit Search Scaling in Search Procedures