Learn Before
Deriving a Missing Input from a Memory State
A memory state is calculated as a tuple containing the arithmetic mean of key vectors and the arithmetic mean of value vectors. After processing three key-value pairs (indexed 0, 1, and 2), the final memory state is Mem = ([3, 4], [5, 6]). Given the first two pairs are k₀ = [1, 2], v₀ = [7, 8] and k₁ = [2, 3], v₁ = [4, 5], what are the vectors for the third key-value pair, k₂ and v₂? Show your work.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Consider a sequence of three key-value pairs. The key vectors are k₀ = [1, 2], k₁ = [2, 3], and k₂ = [3, 1]. The corresponding value vectors are v₀ = [3, 0], v₁ = [1, 5], and v₂ = [2, 1]. If a memory state is defined as a tuple containing the arithmetic mean of the key vectors and the arithmetic mean of the value vectors, what is the resulting memory state after processing all three pairs?
Deriving a Missing Input from a Memory State
Evaluating a Simple Memory Mechanism