Learn Before
Formula

Context Window Slice Notation (K[inc+1,i]\mathbf{K}_{[i-n_c+1,i]})

The notation K[inc+1,i]\mathbf{K}_{[i-n_c+1,i]} represents a specific slice of a sequence of key vectors, corresponding to a context window of size ncn_c ending at position ii. Formally, this slice is represented as a matrix constructed by vertically stacking the key vectors from index inc+1i - n_c + 1 to ii: K[inc+1,i]=[kinc+1ki]\mathbf{K}_{[i - n_c + 1,i]} = \begin{bmatrix} \mathbf{k}_{i - n_c + 1} \\ \vdots \\ \mathbf{k}_{i} \end{bmatrix}. For simplicity, this context window is also frequently denoted as a set of vectors: K[inc+1,i]={kinc+1,,ki}\mathbf{K}_{[i - n_c + 1,i]} = \{\mathbf{k}_{i - n_c + 1},\dots,\mathbf{k}_{i}\}.

Image 0

0

1

Updated 2026-04-22

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences