Learn Before
Determining Matrix Dimensions from a Sliding Window
Imagine you have a long sequence of 128-dimensional value vectors. You are processing this sequence using a sliding window that considers the 16 most recent vectors at any given time. What will be the dimensions (rows × columns) of the matrix formed by vertically stacking the value vectors contained within this window?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Formula for Fixed-Size Window Memory
Consider a sequence of 2-dimensional value vectors, where:
- v_1 = [10, 11]
- v_2 = [12, 13]
- v_3 = [14, 15]
- v_4 = [16, 17]
- v_5 = [18, 19]
Given a current processing index of i = 5 and a context window size of nc = 3, which matrix below correctly represents the structure formed by vertically stacking the value vectors from the corresponding sliding window, from index i - nc + 1 to i?
Inferring Window Parameters
Determining Matrix Dimensions from a Sliding Window