Error Propagation in CoT Reasoning Steps
A key vulnerability in the Chain-of-Thought (CoT) process is the risk of error propagation. An inaccuracy or logical flaw in any of the intermediate reasoning steps can cascade through the sequence, ultimately leading to an incorrect final conclusion, even if the subsequent steps are logically sound.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Difficulty of Creating Few-Shot CoT Demonstrations
Lack of Standardized Problem Decomposition in CoT
Error Propagation in CoT Reasoning Steps
Diagnosing a Reasoning Failure in a Multi-Step Prompt
A team is using a large language model to perform complex multi-step financial analysis. They provide the model with several examples of how to break down a problem and arrive at a conclusion. However, they notice that the model's performance is inconsistent. Prompts created by senior analysts, who use a methodical approach to breaking down the problem, yield reliable results. In contrast, prompts created by junior analysts, who each use their own ad-hoc approach, often lead the model to make lo
Evaluating Prompting Strategies for High-Stakes Tasks