Example of LLM Refusal with Irrelevant Context
When a Large Language Model is prompted with a question like 'Where will the 2028 Olympics be held?' but is only given irrelevant context, such as information about the 2024 Paris Olympics, it may decline to provide an answer. This refusal stems from the provided text being insufficient to form an accurate response.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Using a Search Engine for Text Retrieval
Example of Retrieved Text for the 2028 Olympics Question
Historical Context of Los Angeles as a Three-Time Olympics Host
Timeline of Recent Olympic Games in the United States
Example of Retrieved Text for the 2024 Olympics
Example RAG Prompt for the 2028 Olympics Question
Example of LLM Refusal with Irrelevant Context
Example of a Hybrid Prompt Combining RAG and Tool Use
A user asks a language model the following question: 'Where will the 2028 Olympics be held?' To generate an accurate answer, the model is provided with an external text snippet. Which of the following text snippets would be most effective for the model to use in its response?
Evaluating Information Sufficiency for an Answering System
An automated answering system is tasked with answering a user's question based only on a provided text.
User's Question: 'Where will the 2028 Olympics be held?'
Provided Text: 'The 2028 Summer Olympics, also known as Los Angeles 2028, is a forthcoming international multi-sport event. It is scheduled to be held in the United States from July 14 to July 30, 2028. This will be the first time the Olympic Games have been hosted in the United States since the 2002 Winter Games in Salt Lake City.'
Which of the following is the most accurate and faithful answer the system can generate from the provided text?
Example of LLM Refusal with Irrelevant Context
Learn After
A user asks a language model, 'What is the capital of Australia?'. The model is instructed to answer only using the information from the following text: 'Sydney is a vibrant city in Australia, famous for its opera house and harbor bridge. It is the most populous city in the country and a major hub for tourism and finance.' Which of the following is the most appropriate and faithful response for the model to generate?
Evaluating a Chatbot's Fidelity
Generating a Faithful LLM Response