Learn Before
A memory system for handling long sequences uses a two-level cache: a fixed-size local memory for recent, high-fidelity items and a compressed memory for a summarized history of older items. When the local memory is full and a new key-value pair is added, the oldest pair is evicted. What is the immediate fate of this evicted key-value pair according to this design?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A memory system uses a two-level structure: a full, fixed-size local memory for recent items and a compressed memory for older items. When a new key-value pair is generated, several actions occur to update the system. Arrange the following actions in the correct chronological order.
Hybrid Cache State Transition
A memory system for handling long sequences uses a two-level cache: a fixed-size local memory for recent, high-fidelity items and a compressed memory for a summarized history of older items. When the local memory is full and a new key-value pair is added, the oldest pair is evicted. What is the immediate fate of this evicted key-value pair according to this design?