Learn Before
Context Window Slice Notation ()
The notation represents a specific slice of a sequence of key vectors, corresponding to a context window of size ending at position . Formally, this slice is represented as a matrix constructed by vertically stacking the key vectors from index to : . For simplicity, this context window is also frequently denoted as a set of vectors: .

0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Sequence Slicing Notation for Last Elements
Matrix Slice Notation for a Sequence Window ()
A matrix is a rectangular array of numbers organized into rows and columns. Given this definition, which of the following correctly uses standard notation to represent a 2x3 matrix (2 rows and 3 columns) containing the integers from 1 to 6?
Concatenated Matrix Notation ()
Row Vector Notation ()
Matrix Construction
The following expression correctly uses standard notation to represent a 2x2 matrix: { {5, 6}, {7, 8} }
Context Window Slice Notation ()
Column Vector Representation
Learn After
Consider a sequence of elements represented by , where the first element is at index 1. If a segment of this sequence is selected using the notation with a current position and a window size , what is the resulting segment?
Determining Context Window Size
Consider the notation , which defines a segment of a sequence of size ending at position . True or False: If the window size is increased while the final position is held constant, the segment's starting position will shift to a higher index (i.e., further along in the sequence).