Learn Before
Definition

Notation for Preceding Output Subsequence

In autoregressive language models, the notation y<iy_{<i} is commonly used to represent the subsequence of output tokens that precede position ii. This sequence, consisting of y1...yi1y_1...y_{i-1}, provides the context for predicting the token yiy_i. An alternative notation for this same subsequence is yi.

0

1

Updated 2025-10-07

Contributors are:

Who are from:

Tags

Ch.5 Inference - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences