Learn Before
Evaluating a Simple Memory Mechanism
A system represents its memory as a tuple containing two vectors: the arithmetic mean of all key vectors seen so far, and the arithmetic mean of all value vectors seen so far. Critically evaluate this approach by discussing one significant advantage and one significant disadvantage of using a simple arithmetic mean to summarize a sequence of information.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Consider a sequence of three key-value pairs. The key vectors are k₀ = [1, 2], k₁ = [2, 3], and k₂ = [3, 1]. The corresponding value vectors are v₀ = [3, 0], v₁ = [1, 5], and v₂ = [2, 1]. If a memory state is defined as a tuple containing the arithmetic mean of the key vectors and the arithmetic mean of the value vectors, what is the resulting memory state after processing all three pairs?
Deriving a Missing Input from a Memory State
Evaluating a Simple Memory Mechanism