Search Strategy in Step-Level Search
The search strategy component dictates the method of exploring the search space. It leverages the evaluations provided by the verifier to determine which partial reasoning paths should be extended, which should be discarded (pruned), and in what sequence the exploration should proceed.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Search Strategy in Step-Level Search
A system designed to solve problems step-by-step is observed to generate many logically valid intermediate steps. However, it performs poorly because it wastes significant time exploring reasoning paths that, while correct at each step, do not lead to an efficient final solution. Which component of the underlying framework is the most likely source of this inefficiency?
Diagnosing a Flawed Reasoning System
A system is designed to solve complex problems by building a solution one step at a time, evaluating each new step before proceeding. Match each core component of this framework with its specific function in the process.
Node Representation in Step-Level Tree Search
Verification in Step-Level Search
Learn After
A system is generating a multi-step solution to a complex problem. After the first step, it has produced four potential partial solutions. A separate evaluation component has assigned a confidence score to each partial solution, indicating its likelihood of being on the correct path:
- Partial Solution A: Score 0.9
- Partial Solution B: Score 0.8
- Partial Solution C: Score 0.4
- Partial Solution D: Score 0.1
Which of the following best describes the fundamental trade-off the system's search component must navigate when deciding how to proceed?
Analysis of a Flawed Search Strategy
A reasoning system is at a step where it has generated several possible next steps, each with a score from a verifier. Match each search strategy with the description of how it would proceed.
Backtracking in Step-Level Search