Learn Before
Analyzing Candidate Token Likelihood
A language model is generating text and has produced the sequence: 'The scientist discovered a new...'. In the next step, it considers several potential words to continue the sentence. Analyze the provided list of these candidate tokens and their likelihood scores. Based on the preceding text, explain why 'species' and 'planet' have high scores while 'bicycle' has a very low score.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is in the process of generating a sentence. It has already produced the partial sequence: 'The fluffy cat sat'. In the next step, the model needs to generate a set of potential words to extend this sequence. Which of the following lists best represents a plausible set of candidate tokens for the next position?
Analyzing Candidate Token Likelihood
Generating Plausible Next Tokens