Learn Before
A language model is generating the next word and has calculated the following probabilities for the most likely tokens: {'the': 0.40, 'a': 0.25, 'one': 0.15, 'it': 0.10, 'is': 0.05}. If the model uses a probability threshold of p = 0.70 to create a candidate pool for sampling, which set of tokens will be included in that pool?
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is generating the next word and has calculated the following probabilities for the most likely tokens:
{'the': 0.40, 'a': 0.25, 'one': 0.15, 'it': 0.10, 'is': 0.05}. If the model uses a probability threshold ofp = 0.70to create a candidate pool for sampling, which set of tokens will be included in that pool?A text generation model needs to create a candidate pool of tokens for its next selection based on a cumulative probability threshold. Arrange the following actions in the correct chronological order to accurately construct this pool.
Determining the Probability Threshold