Learn Before
A language model is generating a sentence and has identified the three most likely next tokens as 'bright' (initial probability 0.5), 'sunny' (initial probability 0.3), and 'warm' (initial probability 0.1). According to the procedure where a final token is chosen from a limited set of top candidates, the model is guaranteed to select 'bright' as the next token after the probabilities are rescaled, because it has the highest probability.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Output Stage in Top-k Sampling
A language model is generating text and has narrowed down the next possible word to three candidates with the following initial probabilities: 'run' (0.5), 'walk' (0.2), and 'jog' (0.1). Based on the process where a final selection is made from a limited set of top candidates, which of the following actions will occur next?
Calculating Rescaled Probabilities in Text Generation
A language model is generating a sentence and has identified the three most likely next tokens as 'bright' (initial probability 0.5), 'sunny' (initial probability 0.3), and 'warm' (initial probability 0.1). According to the procedure where a final token is chosen from a limited set of top candidates, the model is guaranteed to select 'bright' as the next token after the probabilities are rescaled, because it has the highest probability.