Learn Before
Dimensions of a Context Window Matrix
A sequence of vectors is given, where each vector has a dimension of . A matrix is constructed by stacking the vectors from the sequence that fall within a context window of size . What are the dimensions (rows × columns) of this resulting matrix? Express your answer in terms of and .
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Consider a sequence of 2-dimensional vectors: , , , , and . A matrix is formed by stacking the vectors from index to as rows. If the current position is and the context window size is , which of the following matrices correctly represents ?
Dimensions of a Context Window Matrix
You are given a sequence of 2-dimensional vectors: , , , , , and . A matrix is constructed using the notation , where is the current position and is the context window size. If the resulting matrix is , what were the values of and used to create it?