Sequence Extension with a Sampled Token

An autoregressive language model has generated the sequence of tokens: 'The quick brown fox'. It is now about to generate the next token. Which expression accurately describes how the model will select this next token?

An autoregressive model selects the next token by sampling from a conditional probability distribution, represented by the formula: $\bar{y}_i \sim Pr(y_i|x, y_{<i})$ Match each component of this formula to its correct description.

Explaining Model Output Variability