Learn Before
Context Window Vector Set Notation ()
The notation represents a set of vectors that form a context window. In a sequence of vectors, this set includes the vector at the current position along with the preceding vectors up to a certain window size, denoted by . The window starts at the index and ends at the index . This notation is fundamental for models that consider local context to make predictions.

0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Related
Context Window Vector Set Notation ()
An algorithm processes a sequence of data (indexed from 0) by looking at a fixed-size window of items at a time. If the algorithm is currently focused on the item at index 12, and the window size is 7, what is the starting index of the window?
Determining Context Window Size
Debugging a Sliding Window Algorithm
Learn After
Consider a sequence of vectors represented as . For a model processing this sequence, if the current position is and the context window size is , which set of vectors correctly represents the context window ?
Context Window Edge Case Analysis
Debugging a Context Window Implementation
Context Window Matrix Notation ()