Learn Before
Evaluating a Dynamic Global Memory Strategy
A research team is developing a language model to analyze extremely long legal documents. To combat information loss from their model's fixed-size global memory, they propose a new strategy: dynamically increasing the size of the global memory in direct proportion to the input document's length. Evaluate the effectiveness and feasibility of this proposed solution. In your evaluation, analyze the primary trade-off this strategy introduces.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Model Performance on Varying Sequence Lengths
An AI development team is designing a model to summarize lengthy documents. They implement a fixed-size global memory to maintain context. They find that while the model performs well on documents up to 5,000 tokens, its summaries for 50,000-token documents frequently omit critical information from the beginning of the text. Which of the following statements best analyzes the fundamental trade-off the team is facing?
Evaluating a Dynamic Global Memory Strategy