Analyzing a Language Model's Prediction Error
A developer is testing a language model designed to be a cooking assistant. They provide the model with a piece of text and ask it to generate the next few words. Based on the principle of using given information to predict subsequent text, analyze the model's output and explain why it represents a failure in the prediction process.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Examples of Masked Prediction Tasks
A language model is designed to generate the most probable sequence of words based on a given text. If the model is provided with the input: 'After a long day of hiking in the mountains, the tired traveler sat down by the campfire and...'. Which of the following continuations would the model most likely generate?
A language model is tasked with completing a sentence. Given the initial context 'After the storm, a brilliant rainbow', arrange the following words into the most logical sequence that the model would generate one word at a time to complete the thought.
Analyzing a Language Model's Prediction Error