Learn Before
Evaluating Retrieval Relevance
An automated question-answering system receives the user query: 'What were the main economic consequences of the fall of the Berlin Wall for East Germany?'. The system's first step is to retrieve relevant text passages from its knowledge base. From the three passages below, identify which one is the most relevant and explain why it is the best choice to help the system generate an accurate answer.
Passage A: 'Following the fall of the Berlin Wall, East Germany's economy underwent a massive shock. The Treuhandanstalt was established to privatize state-owned enterprises, leading to widespread deindustrialization and high unemployment. The immediate economic consequences included a sharp decline in industrial output.'
Passage B: 'The fall of the Berlin Wall on November 9, 1989, was a pivotal moment in world history, symbolizing the end of the Cold War. It led to the reunification of Germany in October 1990 and was celebrated globally by people from both East and West Berlin.'
Passage C: 'The West German economy, known as the 'Wirtschaftswunder' or economic miracle, experienced robust growth in the post-war era. The introduction of the Deutsche Mark in 1948 stabilized the economy and fostered a period of low inflation and industrial expansion.'
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Implementing RAG Retrieval with Vector Databases
An automated system is designed to answer user questions. Its first step is to search a large document library to find the most relevant texts related to the user's query. The system will then use only these retrieved texts to generate a final answer. A user asks: 'What are the primary health benefits of a Mediterranean diet?' Which of the following sets of retrieved documents would be the most effective for the system's next step?
Using Off-the-Shelf Information Retrieval Systems for RAG
Diagnosing a Flawed Generative Response
Evaluating Retrieval Relevance
Youâre on-call for an internal engineering assista...
You are reviewing two proposed designs for an inte...
Your team is building an internal âRelease Notes Q...
Youâre designing an internal LLM assistant for a c...
Design Review: Choosing Between RAG and k-NN LM for a Regulated Support Assistant
Post-Incident Analysis: Why a RAG Assistant Hallucinated Despite âHaving the Docsâ
Architecture Decision Memo: Unifying Vector-DB RAG and k-NN LM for a Global Policy Assistant
Case Study: Root-Cause Analysis of âCorrect Source, Wrong Answerâ in a RAG + k-NN LM Assistant
Case Study: Debugging a RAG Assistant with a Vector DB and a k-NN LM Memory
Case Review: Diagnosing Conflicting Answers in a Hybrid Retrieval System