Formula

Context Window Vector Set Notation (vinc+1,...,vi{\mathbf{v}_{i-n_c+1}, ..., \mathbf{v}_i})

The notation vinc+1,...,vi{\mathbf{v}_{i-n_c+1}, ..., \mathbf{v}_i} represents a set of vectors that form a context window. In a sequence of vectors, this set includes the vector at the current position ii along with the preceding vectors up to a certain window size, denoted by ncn_c. The window starts at the index inc+1i-n_c+1 and ends at the index ii. This notation is fundamental for models that consider local context to make predictions.

Image 0

0

1

Updated 2026-04-22

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Computing Sciences