Formula

Context Window Matrix Notation (V[inc+1,i]\mathbf{V}_{[i-n_c+1,i]})

The notation V[inc+1,i]\mathbf{V}_{[i-n_c+1,i]} represents a matrix formed by concatenating a sequence of value vectors within a specific context window. Formally, it is constructed by stacking the individual value vectors from index inc+1i - n_c + 1 to ii: V[inc+1,i]=[vinc+1vi]\mathbf{V}_{[i - n_c + 1,i]} = \begin{bmatrix} \mathbf{v}_{i - n_c + 1} \\ \vdots \\ \mathbf{v}_{i} \end{bmatrix}. For notation simplicity, this same context window matrix is sometimes alternatively denoted as the set of its constituent vectors: V[inc+1,i]={vinc+1,,vi}\mathbf{V}_{[i - n_c + 1,i]} = \{\mathbf{v}_{i - n_c + 1},\dots,\mathbf{v}_{i}\}.

Image 0

0

1

Updated 2026-05-02

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences