Analyze the two distinct problems described in the case study below. For each problem, identify which core component of the system is likely underperforming and propose a specific, targeted strategy to improve its performance.

Google

The standard Retrieval-Augmented Generation (RAG) framework is not a fixed system and offers multiple avenues for enhancement beyond its basic, training-free implementation. Performance can be boosted by improving individual components, such as the retrieval system, or by incorporating more advanced techniques like fine-tuning.

Potential for RAG Framework Improvement

Diagnosing and Improving an Information Retrieval System

A company has implemented a system to answer employee questions using its internal knowledge base. Users report that while the system retrieves the correct documents to answer a query, the final generated answers are often too generic and fail to use the company's specific technical jargon. Given this situation, which of the following improvement strategies would most directly address the reported issue?

A team has built a system that answers user questions by first searching a large document collection for relevant information and then using that information to generate a final answer. They want to improve the system's accuracy and are considering two different approaches:

Approach A: Focus on improving the initial search step to ensure the retrieved information is more relevant and precise.
Approach B: Focus on training the final answer generation component using a specialized dataset of high-quality question-and-answer examples from their specific domain.

Compare and contrast these two approaches. In your analysis, discuss the potential benefits and drawbacks of each, and describe the type of performance problem each approach is best suited to solve.

Learn Before

Related