Example of an Algebraic Problem for CoT Illustration
A simple algebraic problem commonly used to illustrate Chain-of-Thought (CoT) prompting is the task of calculating the average of a given set of numbers, for instance, the numbers 2, 4, and 6.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Related
Example of an Algebraic Problem for CoT Illustration
A large language model is given the following word problem: 'A bakery sells muffins for $3 each and cookies for $2 each. If a customer buys 5 muffins and 4 cookies, what is the total cost?' The model produces two different responses based on two different prompting methods.
Response A: 'The total cost is $22.'
Response B:
- Calculate the cost of the muffins: 5 muffins * $3/muffin = $15.
- Calculate the cost of the cookies: 4 cookies * $2/cookie = $8.
- Add the two costs together: $1
Learn After
A developer is testing a language model's ability to solve multi-step arithmetic problems by having it "think out loud." The model is given the task: "What is the average of the numbers 2, 4, and 6?" Which of the following responses from the model best demonstrates a clear, step-by-step reasoning process?
A language model is prompted to 'think step-by-step' to find the average of the numbers 2, 4, and 6. Arrange the following steps into the logical order the model should follow to arrive at the correct answer.
Evaluating a Computational Reasoning Process