Case Study

Speculative Rejection Scenario

A system uses a fast, approximate model (generating probability distribution 'q') to propose outputs, which are then checked against a slower, more accurate model (generating probability distribution 'p'). An output is only considered for rejection if its probability from the fast model is greater than its probability from the slow model. Given the data below, determine which proposed output ('Token X' or 'Token Y') is a candidate for this rejection process, and calculate its specific rejection probability. Explain your reasoning for both tokens.

0

1

Updated 2025-10-03

Contributors are:

Who are from:

Tags

Ch.5 Inference - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science