Learn Before
Improving Demonstrations for Logical Reasoning
A developer is using a few-shot prompt to teach a language model to solve simple logic puzzles. The model's performance is inconsistent. Below is one of the demonstrations included in the prompt:
Input: 'If all Wibs are Wobs, and all Wobs are Wubs, are all Wibs also Wubs?' Output: 'Yes.'
Analyze this demonstration. Identify a key weakness in its structure and explain how you would modify it to more effectively guide the model's reasoning process.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Evaluating Prompt Demonstration Quality
A developer is creating a prompt to solve multi-step math word problems. The prompt includes several examples of problems and their final answers. However, the model frequently makes logical errors on new, unseen problems. Based on principles for optimizing in-context examples, what is the most likely flaw in the prompt's design?
Improving Demonstrations for Logical Reasoning