Learn Before
Sufficiency of Demonstrations in Few-Shot Learning
For a large language model to successfully perform a task via few-shot learning, the prompt must contain a sufficient number of demonstrations. Although the required number of examples is generally small, it must be adequate for the model to recognize the underlying input-output pattern of the task.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Examples of Few-Shot Learning Applications in NLP
Enabling Few-Shot Learning with Multiple Demonstrations
Input-Output Patterns in Few-Shot Learning
Sufficiency of Demonstrations in Few-Shot Learning
Applying Few-Shot Learning to Complex Reasoning Tasks
A user provides the following text to a large language model to get it to classify movie reviews:
Review: The plot was predictable and the acting was wooden. I was bored the entire time. Sentiment: Negative
Review: An absolute masterpiece! The cinematography was stunning and the story was deeply moving. Sentiment: Positive
Review: It was a decent film. Not the best I've seen this year, but it had some good moments. Sentiment: Neutral
Review: I couldn't stop laughing from beginning to end. A brilliant comedy. Sentiment:
The model correctly responds with "Positive". Which statement best analyzes the primary reason for the model's successful performance on this task?
Constructing a Few-Shot Prompt for a Novel Task
Critiquing a Prompt for a Custom Extraction Task
Example of a Few-Shot Prompt for Polarity Classification
Learn After
A developer is trying to get a language model to classify short movie reviews as 'Positive', 'Negative', or 'Neutral'. They test two different sets of instructions, shown below.
Instructions A: Classify the following movie review. Review: The plot was predictable and the acting was wooden. Classification: Negative
Review: This film was an absolute masterpiece from start to finish. Classification:
Instructions B: Classify the following movie reviews. Review: The plot was predictable and the acting was wooden. Classification: Negative
Review: It wasn't a bad movie, but it wasn't particularly memorable either. Classification: Neutral
Review: This film was an absolute masterpiece from start to finish. Classification: Positive
Review: I have seen better, but it was an enjoyable way to spend an afternoon. Classification:
Why are 'Instructions B' significantly more likely to lead to a correct and reliable classification for the final review compared to 'Instructions A'?
Diagnosing Few-Shot Learning Failures
Evaluating Demonstration Sufficiency in a Prompt