Learn Before
Consider a sequence of 2-dimensional value vectors, where:
- v_1 = [10, 11]
- v_2 = [12, 13]
- v_3 = [14, 15]
- v_4 = [16, 17]
- v_5 = [18, 19]
Given a current processing index of i = 5 and a context window size of nc = 3, which matrix below correctly represents the structure formed by vertically stacking the value vectors from the corresponding sliding window, from index i - nc + 1 to i?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Formula for Fixed-Size Window Memory
Consider a sequence of 2-dimensional value vectors, where:
- v_1 = [10, 11]
- v_2 = [12, 13]
- v_3 = [14, 15]
- v_4 = [16, 17]
- v_5 = [18, 19]
Given a current processing index of i = 5 and a context window size of nc = 3, which matrix below correctly represents the structure formed by vertically stacking the value vectors from the corresponding sliding window, from index i - nc + 1 to i?
Inferring Window Parameters
Determining Matrix Dimensions from a Sliding Window