Refining an LLM Response Using Feedback
The final stage in a self-refinement cycle involves prompting the Large Language Model to revise its initial answer. This is done by providing the model with the feedback that was generated in the previous step, guiding it to produce an improved and more accurate response.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Using Generated Feedback to Prompt for Response Refinement
Example of a Feedback Generation Prompt
Refining LLM Responses Using Feedback
Refining an LLM Response Using Feedback
A user provides a language model with the following query and receives an initial response:
User Query: "What are the main causes of urban air pollution?" Initial Response: "Urban air pollution is caused by things like cars and factories."
The user now wants to prompt the same model to critique its own response to identify areas for improvement. Which of the following subsequent prompts is best designed to elicit the most detailed and constructive feedback on the initial response?
Evaluating a Feedback Generation Prompt
A user is interacting with a language model to refine an explanation. Arrange the following four steps of their interaction into the correct chronological order.
An AI model was tasked with summarizing a complex scientific article. Its initial summary was factually correct but overly technical and difficult for a non-expert to understand. The model then received the following critique: 'The summary is too dense. Simplify the language, use an analogy to explain the core concept, and define key terms.' Which of the following prompts best represents the final step of using this critique to improve the summary?
Refining an LLM Response Using Feedback
Refining LLM Responses Using Feedback
Applying Feedback to Revise an LLM-Generated Poem
An AI assistant is programmed to improve its own answers through an iterative process. Arrange the following actions into the correct logical sequence that the AI would follow to enhance its response to a user's query.
Learn After
Example of a Refinement Prompt Structure
An AI model produced an initial response to a prompt and was then provided with feedback to help it improve.
Initial Prompt: 'Explain the water cycle for a 5th grader.'
AI's Initial Response: 'Water on Earth goes up into the sky and then comes back down.'
Feedback Provided to the AI: 'This response is too brief. It lacks key terminology like evaporation, condensation, and precipitation, and doesn't explain what causes the water to move.'
Based on the feedback, which of the following revised responses demonstrates the most successful refinement?
Inferring Guidance for AI Revision
Diagnosing a Flawed Refinement Cycle