Acceptance-Rejection Mechanism for Speculative Decoding

Evaluation Model for Predicted Sequences

Inequality Constraint for Predicted Future Value Functions ($q(\hat{y}_{i+t}) \leq p(\hat{y}_{i+t})$)

A text-generation model has produced the sequence 'The quick brown fox'. The model is now at the 4th position (after 'fox') and is predicting the next word in the sequence. It predicts the word 'jumps' will appear at the 5th position. Which of the following expressions correctly represents the probability assigned by the model to this specific prediction?

In the context of a model generating a sequence of values, match each component of the notation p(ŷ_{i+t}) to its correct description.

Rejection Criterion in Speculative Sampling

Interpreting a Weather Forecasting Model's Output