Learn Before
Initial Step in Text Generation
A language model is generating text and has so far produced the sequence: 'The quick brown fox jumps over the'. Describe the immediate first action the model takes to determine the very next word, and provide three distinct and plausible examples of words that might be produced during this initial action.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is generating text one token at a time using a multi-stage process. After processing the input 'The sky is', the model's first stage is to generate a set of potential next tokens. Which of the following options best represents the direct output of this initial generation stage?
Initial Step in Text Generation
In a multi-stage text generation process, the initial 'expansion' stage is responsible for analyzing the probabilities of all potential next tokens and selecting only the single most probable token to continue the sequence.