Learn Before
Analyzing Text Generation Behavior
A language model is given the same prompt twice but uses a different method for generating the text each time, resulting in the two outputs below. Based on your understanding of how text generation works, analyze the fundamental difference in the approaches that likely produced Output A versus Output B. Specifically, comment on how each approach likely navigates the space of possible next words at each step of the generation process.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Heuristic Search Algorithms for LLM Inference
Stopping Criteria in LLM Inference
Computational Infeasibility of Exhaustive Search in LLM Decoding
A language model is given the prompt 'The capital of France is'. Internally, the model's calculations show that the single most probable next word is 'Paris'. However, the model ultimately generates the sequence 'The capital of France is a beautiful city'. Which statement best analyzes the reason for this discrepancy?
The Challenge of Generating Optimal Text
Analyzing Text Generation Behavior