Learn Before
Speculative Rejection Scenario
A system uses a fast, approximate model (generating probability distribution 'q') to propose outputs, which are then checked against a slower, more accurate model (generating probability distribution 'p'). An output is only considered for rejection if its probability from the fast model is greater than its probability from the slow model. Given the data below, determine which proposed output ('Token X' or 'Token Y') is a candidate for this rejection process, and calculate its specific rejection probability. Explain your reasoning for both tokens.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A predictive system is evaluating a potential output. The probability of this output under distribution 'p' is 0.2, and the probability under distribution 'q' is 0.8. Given that the probability from 'q' is greater than the probability from 'p', what is the probability that this potential output will be rejected?
Speculative Rejection Scenario
Analyzing the Speculation Rejection Formula