Learn Before
Context Window Matrix Notation ()
The notation represents a matrix formed by concatenating a sequence of value vectors within a specific context window. Formally, it is constructed by stacking the individual value vectors from index to : . For notation simplicity, this same context window matrix is sometimes alternatively denoted as the set of its constituent vectors: .

0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Consider a sequence of vectors represented as . For a model processing this sequence, if the current position is and the context window size is , which set of vectors correctly represents the context window ?
Context Window Edge Case Analysis
Debugging a Context Window Implementation
Context Window Matrix Notation ()
Learn After
Consider a sequence of 2-dimensional vectors: , , , , and . A matrix is formed by stacking the vectors from index to as rows. If the current position is and the context window size is , which of the following matrices correctly represents ?
Dimensions of a Context Window Matrix
You are given a sequence of 2-dimensional vectors: , , , , , and . A matrix is constructed using the notation , where is the current position and is the context window size. If the resulting matrix is , what were the values of and used to create it?