Evaluating a Feedback Generation Prompt
A user is attempting to have an AI model refine its own work. After receiving an initial response, the user prompts the model to critique that response. Analyze the scenario below and explain why the prompt used to generate the feedback was likely ineffective. Then, describe two specific qualities of a better prompt for this purpose.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Using Generated Feedback to Prompt for Response Refinement
Example of a Feedback Generation Prompt
Refining LLM Responses Using Feedback
Refining an LLM Response Using Feedback
A user provides a language model with the following query and receives an initial response:
User Query: "What are the main causes of urban air pollution?" Initial Response: "Urban air pollution is caused by things like cars and factories."
The user now wants to prompt the same model to critique its own response to identify areas for improvement. Which of the following subsequent prompts is best designed to elicit the most detailed and constructive feedback on the initial response?
Evaluating a Feedback Generation Prompt
A user is interacting with a language model to refine an explanation. Arrange the following four steps of their interaction into the correct chronological order.