Learn Before
Example

Example of Pruning in a Step-Level Search Tree

A step-level search can be visualized as exploring a tree where the root is the input problem, and the tree expands by generating multiple reasoning steps at each point. Each candidate step can be pruned either due to its low generation likelihood from the language model (similar to standard decoding) or by failing an explicit step-level verification check. The surviving unpruned candidates are then expanded to generate further reasoning steps. This continuous process of expansion and pruning allows the system to focus computational resources on the most promising paths, iterating until a complete reasoning chain forming a final answer is generated or a predefined search limit is reached.

Image 0

0

1

Updated 2026-05-06

Contributors are:

Who are from:

Tags

Ch.5 Inference - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences