Learn Before
The Challenge of Generating Optimal Text
Imagine a language model is tasked with generating a 10-word sentence. At each of the 10 steps, it considers the 5 most likely words to add next. To find the single best 10-word sentence, why is it computationally impractical for the model to evaluate every single possible combination of these words? Explain the core challenge that this scenario illustrates for text generation.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Heuristic Search Algorithms for LLM Inference
Stopping Criteria in LLM Inference
Computational Infeasibility of Exhaustive Search in LLM Decoding
A language model is given the prompt 'The capital of France is'. Internally, the model's calculations show that the single most probable next word is 'Paris'. However, the model ultimately generates the sequence 'The capital of France is a beautiful city'. Which statement best analyzes the reason for this discrepancy?
The Challenge of Generating Optimal Text
Analyzing Text Generation Behavior