Lack of Standardized Problem Decomposition in CoT
A practical limitation of Chain-of-Thought (CoT) is the absence of a standardized methodology for problem decomposition. The process of breaking down a complex problem into a sequence of simpler, intermediate steps is often subjective and relies heavily on the prompt engineer's individual experience and intuition.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Difficulty of Creating Few-Shot CoT Demonstrations
Lack of Standardized Problem Decomposition in CoT
Error Propagation in CoT Reasoning Steps
Diagnosing a Reasoning Failure in a Multi-Step Prompt
A team is using a large language model to perform complex multi-step financial analysis. They provide the model with several examples of how to break down a problem and arrive at a conclusion. However, they notice that the model's performance is inconsistent. Prompts created by senior analysts, who use a methodical approach to breaking down the problem, yield reliable results. In contrast, prompts created by junior analysts, who each use their own ad-hoc approach, often lead the model to make lo
Evaluating Prompting Strategies for High-Stakes Tasks