RAG Chatbot Response Strategy for Undocumented Issues
A software company has a chatbot to help engineers with technical questions, powered by a system that searches internal documentation. An engineer asks for a solution to a brand-new software bug that is not yet in the documentation, so the system finds no relevant information.
Evaluate the potential risks and benefits of two different response strategies for the chatbot in this scenario:
- The chatbot states it cannot find the information and refuses to answer.
- The chatbot uses its general, pre-trained knowledge to propose a potential solution, clearly stating that the information is not from the official documentation.
Based on your evaluation, which strategy is more appropriate for this specific use case and why?
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A user asks a chatbot, which is designed to answer questions based on a specific corporate knowledge base, 'What were the key findings from the global tech summit that concluded yesterday?' The knowledge base was last updated a week ago and contains no information about the summit. The chatbot responds with a detailed, accurate summary of the summit's key findings. Which statement best evaluates this interaction?
RAG System Response Strategy
RAG Chatbot Response Strategy for Undocumented Issues