Learn Before
Evaluating a Prompt for a Language Model
A developer is trying to get a language model to solve multi-step word problems by showing it an example. Analyze the following prompt. Based on the principles of effective reasoning guidance, evaluate its likelihood of success and explain the most critical flaw in its design.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Few-Shot Chain-of-Thought (CoT) Prompting
A user provides the following text to a large language model:
Question: A cafeteria had 23 apples. If they used 20 to make lunch and bought 6 more, how many apples do they have?
Answer: The cafeteria started with 23 apples. They used 20, so they had 23 - 20 = 3 apples. Then they bought 6 more, so they now have 3 + 6 = 9 apples. The final answer is 9.
Question: Roger has 5 tennis balls. He buys 2 more cans of tennis balls. Each can has 3 tennis balls. How many tennis balls does he have now?
Which statement best analyzes the structure of this prompt and its intended effect on the model's problem-solving process?
Constructing a One-Shot CoT Prompt
Evaluating a Prompt for a Language Model
Example of a One-Shot CoT Prompt with Arithmetic Problems