Learn Before
Diagnosing a Failing Customer Support Chatbot
A company develops a customer support chatbot using a large, general-purpose language model. Soon after launch, they receive complaints that the chatbot provides information based on a year-old return policy and is unaware of any products released in the last six months. Based on these symptoms, analyze the fundamental architectural limitation of this chatbot and describe a specific mechanism you would implement to ensure its responses are always accurate and current.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Diagnosing a Failing Customer Support Chatbot
A company deploys two AI assistants to answer questions about its newest software version, which was released yesterday.
- Assistant A responds: 'I'm sorry, but my knowledge base was last updated several months ago, and I do not have information on the most recent software release.'
- Assistant B responds: 'The new software version includes features X, Y, and Z. You can find the full release notes in our official documentation.'
Which of the following best explains why Assistant B was able to provide a helpful, up-to-date answer while Assistant A could not?
A company implements an AI-powered chatbot to help employees find information in its extensive, frequently updated internal knowledge base. Users report that while the chatbot's language is fluent, its answers are often irrelevant or based on outdated information, even for simple queries. Assuming the core language model is functioning correctly, what is the most likely component of the system to investigate first to resolve this issue?