Learn Before
A language model is generating text one token at a time using a multi-stage process. After processing the input 'The sky is', the model's first stage is to generate a set of potential next tokens. Which of the following options best represents the direct output of this initial generation stage?
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is generating text one token at a time using a multi-stage process. After processing the input 'The sky is', the model's first stage is to generate a set of potential next tokens. Which of the following options best represents the direct output of this initial generation stage?
Initial Step in Text Generation
In a multi-stage text generation process, the initial 'expansion' stage is responsible for analyzing the probabilities of all potential next tokens and selecting only the single most probable token to continue the sequence.