Learn Before
Three-Step Framework for Self-Refinement in LLMs
A widely recognized general framework for self-refinement using Large Language Models consists of a three-step process, as outlined by Madaan et al. (2024).
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Example of Self-Refinement in Machine Translation
Three-Step Framework for Self-Refinement in LLMs
Ideal Self-Refinement without Additional Training
Fine-Tuning LLMs for Self-Refinement Tasks
Task-Specific Models as an Alternative for Refinement
Self-Refinement as an LLM Alignment Issue
Self-Reflection in LLMs
A developer is using a large language model to generate a Python function for a complex data analysis task. The developer's workflow is as follows:
- The model generates an initial version of the function.
- The developer then prompts the same model, providing the initial function and asking it to 'act as a senior code reviewer, identify potential bugs or inefficiencies, and explain how to fix them.'
- Based on the model's feedback, a final, improved version of the function is produced.
This iterative process of generating an output, using the model to critique its own output, and then improving it based on that critique is best described as:
Applying an Iterative Improvement Framework
Product Design as an Analogy for Self-Refinement
Relationship between Self-Refinement and Self-Reflection in LLMs
Comparing Output Improvement Strategies
Your team is rolling out an internal LLM assistant...
You’re building an internal LLM workflow to produc...
You’re building an internal LLM assistant to help ...
You’re leading an internal enablement team buildin...
Choosing and Justifying a Prompting Strategy Under Context and Quality Constraints
Designing a Prompting Workflow for a High-Stakes, Multi-Step Task
Diagnosing and Redesigning a Prompting Approach for a Decomposed Workflow
Stabilizing an LLM Workflow for Multi-Step Policy Compliance Decisions
Debugging a Multi-Step LLM Workflow for Contract Clause Risk Triage
Designing a Robust Prompting Workflow for Multi-Step Root-Cause Analysis with Limited Examples
Learn After
Prediction: The First Step of Self-Refinement
Feedback Collection: The Second Step of Self-Refinement
Refinement: The Third Step of Self-Refinement
Iterative Self-Refinement Process
Deliberate-then-Generate (DTG) Method
A common framework for improving a language model's output involves a cyclical process. Arrange the following stages of this process into the correct logical order, from start to finish.
A development team is improving a news-summarizing AI. Their process is as follows:
- The AI generates an initial summary of an article.
- A separate automated tool critiques the summary for conciseness and factual accuracy, producing a list of issues.
- The AI is then given the original article, its first summary, and the list of issues, and is prompted to write an improved version.
Which option correctly maps this process to the standard three-step self-refinement framework?
Analyzing a Flawed Self-Improvement Process