Optimizing a Chatbot's Information Retrieval
A development team is building a chatbot to answer complex technical questions based on a 500-page product manual. When tested, the chatbot often provides answers that are too general or misses key details. The team is debating two different strategies for providing the manual's content to the language model for each user query. Evaluate the two strategies below and justify which one is more likely to improve the chatbot's performance.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Optimizing a Chatbot's Information Retrieval
A developer is building a legal document summarization tool using a large language model. To provide comprehensive context, for every summarization request, they prepend the full text of the three longest, most cited legal precedents related to the document's general topic. However, they find that the model's summaries often miss key nuances from the specific document being summarized and over-emphasize general principles from the provided precedents. Which of the following best explains this failure in performance?
Diagnosing and Improving Context Management in a Conversational AI