Diagnosing a Flawed Refinement Prompt
A developer is using a Large Language Model (LLM) to iteratively improve its answers. They provide the LLM with feedback on its initial response using the following prompt: 'Here is some feedback on your last answer. Please provide a better response.' The developer observes that the LLM's revised answers often miss the point of the original user query or seem to ignore the context of its first attempt. Based on the principles of effective prompt design for response refinement, analyze the flaw in the developer's prompt and explain how it leads to the observed issue.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A developer is building a system where a Large Language Model (LLM) iteratively improves its own answers. The process involves three stages: 1) The LLM generates an initial response to a user's question. 2) The LLM generates critical feedback on its own initial response. 3) The LLM uses all the information to generate a final, improved response. Which of the following prompt structures, given to the LLM in the third stage, is best designed to produce a high-quality, refined answer?
Constructing a Refinement Prompt
Diagnosing a Flawed Refinement Prompt