Learn Before
Example of a Demonstration for In-Context Learning
A demonstration for in-context learning typically includes both a problem and its solution. For example, the arithmetic word problem 'Tom has 12 marbles. He wins 7 more marbles in a game with his friend but then loses 5 marbles the next day. His brother gives him another 3 marbles as a gift. How many marbles does Tom have now?' would be presented along with its solution: 'The answer is 17.'
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Example of a Demonstration for In-Context Learning
Calculation Annotation in LLM Prompts
Example of a Demonstration for Sentiment Classification (Positive)
Example of a Demonstration for Sentiment Classification (Negative)
An AI developer provides a large language model with the following prompt: 'First, here are two examples of converting a sentence into a question. Example 1 Input: 'The cat is on the mat.' Example 1 Output: 'Is the cat on the mat?' Example 2 Input: 'They are running a race.' Example 2 Output: 'Are they running a race?' Now, using this pattern, convert the following sentence into a question: 'She is writing a book.' The model successfully outputs: 'Is she writing a book?' Which statement best analyzes the underlying mechanism that allowed the model to succeed?
Improving LLM Output Consistency
When a large language model successfully solves a new problem after being shown several examples within a single prompt, it is because the model's underlying weights have been permanently updated to incorporate the new problem-solving pattern.
Learn After
A developer is trying to get a language model to solve multi-step arithmetic word problems by providing it with an example. Consider the example they use: 'Tom has 12 marbles. He wins 7 more marbles in a game with his friend but then loses 5 marbles the next day. His brother gives him another 3 marbles as a gift. How many marbles does Tom have now?' Which statement best analyzes why this is an effective example for this purpose?
Debugging an In-Context Learning Prompt
When constructing a prompt to guide a language model, a single demonstration is considered complete if it only presents the problem that the model is expected to solve.