Learn Before
Inferring Window Parameters
A system is processing a long sequence of value vectors, denoted as . At a certain point in time, it constructs the matrix shown below by stacking the most recent vectors within a sliding window. Based on the structure of this matrix, determine the current processing index (i) and the window size (n_c) that were used.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Formula for Fixed-Size Window Memory
Consider a sequence of 2-dimensional value vectors, where:
- v_1 = [10, 11]
- v_2 = [12, 13]
- v_3 = [14, 15]
- v_4 = [16, 17]
- v_5 = [18, 19]
Given a current processing index of i = 5 and a context window size of nc = 3, which matrix below correctly represents the structure formed by vertically stacking the value vectors from the corresponding sliding window, from index i - nc + 1 to i?
Inferring Window Parameters
Determining Matrix Dimensions from a Sliding Window