Diagnosing and Improving a Reasoning Prompt
A developer is using a large language model to solve simple physics word problems. They provide the following example in their prompt to guide the model:
Question: A car accelerates from rest to 20 m/s in 5 seconds. What is its acceleration?
Answer: 4 m/s²
When the developer then asks the model to solve a new problem, the model provides an incorrect answer. Based on principles of effective prompt design for reasoning tasks, analyze the developer's example and explain why it is likely failing to guide the model effectively. Then, describe how you would rewrite the example to improve the model's performance.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A developer is trying to get a large language model to reliably solve multi-step arithmetic problems. Which of the following example prompts is best structured to guide the model to the correct reasoning process for a new, similar problem?
Improving AI Reasoning with Better Prompts
Diagnosing and Improving a Reasoning Prompt