Learn Before
Determining the Probability Threshold
A language model is selecting its next token. After calculating the probabilities for all possible tokens, it forms a candidate pool from which to sample. Given the initial probabilities and the final candidate pool below, determine the possible range for the probability threshold 'p' that was used. Explain your reasoning.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is generating the next word and has calculated the following probabilities for the most likely tokens:
{'the': 0.40, 'a': 0.25, 'one': 0.15, 'it': 0.10, 'is': 0.05}. If the model uses a probability threshold ofp = 0.70to create a candidate pool for sampling, which set of tokens will be included in that pool?A text generation model needs to create a candidate pool of tokens for its next selection based on a cumulative probability threshold. Arrange the following actions in the correct chronological order to accurately construct this pool.
Determining the Probability Threshold