1Cademy - Context Window of Value Vectors Set Notation ($$\{ \mathbf{v}_{i-n_c+1}, \dots, \mathbf{v}

Learn Before

Start Index Calculation for a Context Window

Formula

Context Window of Value Vectors Set Notation ( $\{ \mathbf{v}_{i-n_c+1}, \dots, \mathbf{v}_i \}$ )

The notation $\left\{ \mathbf{v}_{i-n_c+1}, \dots, \mathbf{v}_i \right\}$ represents a set of value vectors that form a context window. In a sequence of value vectors, this set includes the vector at the current position $i$ along with the preceding vectors up to a certain window size, denoted by $n_c$ . The window starts at the index $i-n_c+1$ and ends at the index $i$ . This notation is fundamental for models that consider local context to make predictions.