Learn Before
Choosing a Memory Architecture for a Customer Support Chatbot
A development team is building a customer support chatbot. The chatbot must be able to maintain a coherent conversation over many turns with a single user. It also needs to access and incorporate information from a vast knowledge base of past support tickets and technical manuals to answer user queries effectively. The team is considering two different architectures for managing the model's contextual information. Evaluate which of the following architectures is better suited for this task and justify your choice based on how each system conceptualizes and utilizes its memory capacity.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Distinction Between Memory Capacity and Model Complexity
Trade-off Between Performance and Memory Footprint in Memory Models
An engineer is comparing two language model systems. System X uses a mechanism that stores detailed information about the last 4,096 tokens of a conversation. System Y is designed to search through a vast external library of documents and incorporate the most relevant passages into its processing for any given query. Which statement best analyzes the memory capacity of these two systems?
Choosing a Memory Architecture for a Customer Support Chatbot
An AI development team is assessing a new language model's architecture. They are focused on its ability to retain and use information from a long, ongoing conversation. Which of the following metrics most directly quantifies the model's 'memory capacity' in this context?