Learn Before
Evaluating AI Reasoning Process
Based on the following case study, evaluate the AI's response. Is the reasoning process logically sound, even though the final answer is correct? Explain your judgment.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A student is solving the following problem: 'Tom begins with 10 marbles. He wins 7 more in a game, then loses 3, and is finally given 3 more by his brother.' The student calculates the final answer to be 11 marbles. Analyze the student's calculation process. Where did the error most likely occur?
Incorporating Reasoning Steps into Prompts for Improved Model Accuracy
Evaluating AI Reasoning Process
Consider the following problem: 'Tom has 10 marbles. He wins 7 more, then loses 3, and finally receives 3 from his brother.' A valid way to solve this is to first cancel out the 'loses 3' and 'receives 3' actions because they negate each other, leaving the final calculation as 10 + 7 = 17.