Learn Before
A development team is building a chatbot designed to have long, continuous conversations with users, remembering details from hours or even days prior. They decide against using a model with an extremely large, fixed context window and instead opt for an architecture that incorporates an external memory system. What is the most significant new computational trade-off this team introduces by choosing the external memory approach?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Evaluating a Memory-Augmented System for Real-Time Interaction
A development team is building a chatbot designed to have long, continuous conversations with users, remembering details from hours or even days prior. They decide against using a model with an extremely large, fixed context window and instead opt for an architecture that incorporates an external memory system. What is the most significant new computational trade-off this team introduces by choosing the external memory approach?
A company is deploying a memory-augmented LLM. In which of the following scenarios would the computational overhead associated with managing the external memory datastore pose the most significant and continuous challenge?