Learn Before
Advantage of Structured Search in Complex Reasoning
A language model using a simple, step-by-step decoding method consistently fails at multi-step reasoning tasks where an early, seemingly good choice can lead to a dead end. Explain how using a structured search approach, which represents potential outputs as a tree or graph, addresses this specific type of failure.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Monte Carlo Tree Search-Inspired Decoding
Choosing a Decoding Strategy for a Logic Puzzle AI
A language model is tasked with generating a step-by-step solution to a logic puzzle. The puzzle has several plausible initial moves, but an incorrect choice early on will lead to an unsolvable state later. A simple decoding approach that always commits to the single most probable next step often fails on this task. Which of the following alternative strategies is best designed to overcome this specific challenge?
Advantage of Structured Search in Complex Reasoning