Analyzing a Faulty Text Generation Process
Analyze the following scenario and identify the most probable cause of the error, explaining your reasoning based on how the text generation process is initiated.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is tasked with generating a continuation for two different input prompts:
Prompt 1: "The history of the Roman Empire is..." Prompt 2: "The recipe for a perfect pizza dough is..."
When the model begins the process of finding the most likely sequence of words to follow each prompt, how does the starting point (or 'root') of this search process differ between Prompt 1 and Prompt 2?
Analyzing a Faulty Text Generation Process
When a language model is tasked with generating text for two distinct input prompts, the search for the optimal output sequence begins from an identical initial state for both prompts, regardless of the prompts' content.