Learn Before
True or False: For a sequence of key vectors being processed at index with a context window size of , the resulting sub-matrix of key vectors, denoted , will contain the key vectors from index 5 to index 10 (i.e., ).
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Formula for Fixed-Size Window Memory
Suppose you have a sequence of key vectors represented as rows in a matrix, where , , , , and . Given a processing step at index and a context window size of , which matrix is constructed by selecting the contiguous block of key vectors ending at the current step?
Properties of a Sliding Window Key Matrix
True or False: For a sequence of key vectors being processed at index with a context window size of , the resulting sub-matrix of key vectors, denoted , will contain the key vectors from index 5 to index 10 (i.e., ).