Factual Accuracy for a Corporate Chatbot
A financial services company wants to deploy an internal chatbot to help its employees answer complex questions about the company's latest, highly-detailed compliance policies. The primary goal is to ensure every answer is factually correct and strictly based on the official policy documents. The development team is considering two approaches:
-
Approach A: Build a system that first searches the company's internal database of policy documents to find the specific paragraphs relevant to an employee's question. Then, it passes these retrieved paragraphs to a large language model with the instruction to formulate an answer based only on the provided text.
-
Approach B: Use a powerful, general-purpose large language model directly. The model would be prompted with the employee's question and a simple instruction to 'act as a compliance expert' and provide an accurate answer.
Which approach is more suitable for the company's goal? Justify your choice by evaluating the strengths and weaknesses of each approach in the context of the stated requirements.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Factual Accuracy for a Corporate Chatbot
A company implements a chatbot to answer employee questions based on a private, internal knowledge base of company policies. An employee asks the chatbot, 'What is the company's policy on parental leave?' The chatbot provides a detailed, accurate, and up-to-date answer. The employee then asks, 'What are the best public parks near the main office?' The chatbot responds, 'Based on the provided documents, I cannot find any information about public parks.' Which statement best analyzes the chatbot's behavior in the second interaction?
A system is designed to answer a user's question using a large, private collection of documents. The system first finds relevant information within the documents and then uses that information to construct a natural language answer. Arrange the following steps to reflect the correct operational sequence of this system.
Prompt Template for Answer Generation from Context