Formula

Context Window of Key Vectors Set Notation ({ki−nc+1,…,ki}\{ \mathbf{k}_{i-n_c+1}, \dots, \mathbf{k}_i \})

The notation {ki−nc+1,…,ki}\left\{ \mathbf{k}_{i-n_c+1}, \dots, \mathbf{k}_i \right\} represents a set containing a sequence of key vectors. The sequence starts with the key vector k\mathbf{k} at the index i−nc+1i-n_c+1 and concludes with the key vector at index ii. This format is frequently used to define a context window of size ncn_c in sequence modeling.

0

1

Updated 2026-08-11

Contributors are:

Who are from:

Tags

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences