Learn Before
Debugging the Token Selection Process
A developer is examining the output of a specific stage in a language model's text generation process. Based on the two lists provided, determine if the ranking stage is functioning correctly and justify your conclusion.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is generating the next word in a sequence. After an initial step, it has produced a set of candidate words, each with an associated probability. Arrange these candidates in the correct order as they would appear after the ranking stage, from highest probability to lowest.
A language model is generating the next token for a sequence and has produced the following candidate tokens with their associated probabilities:
mat(0.45),floor(0.20),couch(0.30),window(0.05). After the ranking stage is completed, which of the following statements best describes the state of these candidates?Debugging the Token Selection Process