Example

Visual Diagram of Cascading Inference

A visual representation of cascading inference illustrates a two-step process. In Step 1, which is computationally cheap, an input x is processed by a small model to produce an initial output y1. A decision is then made based on whether this result is satisfactory. If it is not, the process proceeds to the expensive Step 2, where the original input x is processed by a large model to generate the final output y.

0

1

Updated 2025-10-10

Contributors are:

Who are from:

Tags

Ch.4 Alignment - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences