Learn Before
Definition icon
Definition

Vector Prefix Notation

Vector prefix notation, commonly denoted as X≤i\mathbf{X}_{\leq i}, represents the sequence of all vectors from the beginning of a sequence up to and including the ii-th position. For example, if X\mathbf{X} is a sequence of vectors, then X≤i=(x1,x2,…,xi)\mathbf{X}_{\leq i} = (\mathbf{x}_1, \mathbf{x}_2, \dots, \mathbf{x}_i). This notation is frequently used in autoregressive models to refer to the prefixes of key (K≤i\mathbf{K}_{\leq i}) and value (V≤i\mathbf{V}_{\leq i}) sequences that have been processed so far.

0

1

Definition icon
Updated 2026-05-02

Contributors are:

Who are from:

Tags

Ch.5 Inference - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Ch.2 Generative Models - Foundations of Large Language Models

Related