A language model is asked to solve the following word problem: 'Tom starts with 12 marbles. He then wins 7, loses 5, and is given another 3. How many marbles does Tom have in the end?' The model produces the reasoning below. Identify the step where the model makes a logical error in translating the problem's narrative into a mathematical operation.
Step 1: Tom begins with 12 marbles. Step 2: Tom wins 7 marbles, so the total becomes 12 + 7 = 19. Step 3: Tom loses 5 marbles, so the total becomes 19 + 5 = 24. Step 4: Tom is given 3 marbles, so the final total is 24 + 3 = 27.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
First Reasoning Step for the ICL Demonstration on Marbles
A language model is tasked with solving the following word problem: 'Tom starts with 12 marbles. He then wins 7, loses 5, and is given another 3. How many marbles does Tom have in the end?' To guide the model's reasoning process, which of the following sequences of steps most accurately and logically breaks down the problem into a step-by-step calculation that follows the narrative?
Analyzing a Language Model's Reasoning Process
A language model is asked to solve the following word problem: 'Tom starts with 12 marbles. He then wins 7, loses 5, and is given another 3. How many marbles does Tom have in the end?' The model produces the reasoning below. Identify the step where the model makes a logical error in translating the problem's narrative into a mathematical operation.
Step 1: Tom begins with 12 marbles. Step 2: Tom wins 7 marbles, so the total becomes 12 + 7 = 19. Step 3: Tom loses 5 marbles, so the total becomes 19 + 5 = 24. Step 4: Tom is given 3 marbles, so the final total is 24 + 3 = 27.