Example of LLM Generating Sub-Problems for a Duration Question
An LLM can be prompted with examples of problem decomposition to learn how to break down new, unseen problems. For instance, after being shown how other questions are broken down, the model can correctly generate the necessary sub-problems, such as 'When did the environmental study start?' and 'When did the environmental study end?', to solve a novel question about the study's duration.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Example of an Instructional Prompt in a Few-Shot Setting for Sub-Problem Decomposition
Example of LLM Generating Sub-Problems for a Duration Question
A developer is using a large language model to solve a complex, multi-step reasoning problem. The goal is for the model to first break the problem down into a sequence of simpler sub-problems and then solve them in order. The developer provides the model with the complex problem and the simple instruction: 'Here is a problem. Solve it.' The model attempts to answer directly but fails. Which of the following best explains why the model failed to break the problem down as intended?
Sequential Sub-Problem Solving with Contextual QA Pairs
A developer wants to guide a Large Language Model to break down a complex problem into simpler sub-problems. Arrange the following components into the most effective and logical sequence for a one-shot prompt to accomplish this task.
Guiding an LLM for Problem Decomposition
Formula for Least-to-Most Sub-Problem Generation
Learn After
An AI model is provided with the following examples to learn how to break down a main question into a series of smaller, solvable sub-questions:
Example 1: Main Question: What is the price difference between a laptop and a tablet? Sub-questions:
- What is the price of the laptop?
- What is the price of the tablet?
Example 2: Main Question: How many more pages are in 'War and Peace' than in 'The Great Gatsby'? Sub-questions:
- How many pages are in 'War and Peace'?
- How many pages are in 'The Great Gatsby'?
Based on the pattern demonstrated in these examples, which set of sub-questions would the model most logically generate for the new main question: 'How long did the construction of the Golden Gate Bridge take?'
Diagnosing a Flawed Problem Decomposition
Generating Sub-Problems for a Duration Calculation