Learn Before
An engineer is comparing two language model systems. System X uses a mechanism that stores detailed information about the last 4,096 tokens of a conversation. System Y is designed to search through a vast external library of documents and incorporate the most relevant passages into its processing for any given query. Which statement best analyzes the memory capacity of these two systems?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Distinction Between Memory Capacity and Model Complexity
Trade-off Between Performance and Memory Footprint in Memory Models
An engineer is comparing two language model systems. System X uses a mechanism that stores detailed information about the last 4,096 tokens of a conversation. System Y is designed to search through a vast external library of documents and incorporate the most relevant passages into its processing for any given query. Which statement best analyzes the memory capacity of these two systems?
Choosing a Memory Architecture for a Customer Support Chatbot
An AI development team is assessing a new language model's architecture. They are focused on its ability to retain and use information from a long, ongoing conversation. Which of the following metrics most directly quantifies the model's 'memory capacity' in this context?