Analyzing a Failed Prompt for a Logic Puzzle
A developer is prompting a large language model to solve logic puzzles. The model fails on a new puzzle. Analyze the developer's prompt below and identify the fundamental reason for the model's failure.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Ch.3 Prompting - Foundations of Large Language Models
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Chain-of-Thought (COT) Prompting
Explicitly Prompting for a Reasoning Process to Prevent Errors
A user wants a language model to solve a multi-step math word problem. The user's prompt includes an example of a different, but structurally similar, word problem along with its final numerical answer. Despite this example, the model fails to solve the new problem correctly. Which statement best analyzes the most probable cause of the model's failure?
Analyzing a Failed Prompt for a Logic Puzzle
Diagnosing LLM Prompting Failures