A large language model is asked to calculate the average of the numbers 2, 4, and 9. It incorrectly responds with the answer 7. Propose a revised prompt that is more likely to lead the model to the correct answer of 5. Explain the reasoning behind your revised prompt, detailing why it is more effective than the original.

Google

When prompted to calculate the average of the numbers 2, 4, and 9, a Large Language Model might provide the answer 7. This response is incorrect, as the actual average is 5, calculated as $(2+4+9)/3$.

LLM's Answer (7) to the Prompt for Calculating the Average of 2, 4, and 9

A large language model is prompted: 'What is the average of 2, 4, and 9?'. The model incorrectly responds: 'The average is 7.' Which of the following provides the most plausible analysis of the model's logical error?

Improving LLM Arithmetic Accuracy

Analyze the model's response in the following scenario. First, perform the correct calculation to find the true average. Second, propose a specific, plausible arithmetic error the model could have made in its own calculation process to arrive at the incorrect answer of 7. Justify your proposal by showing the flawed calculation.

Learn Before

Related