Search (Decoding) Algorithms for LLM Inference

Establishing the Initial Context for Inference

A user provides a large document (e.g., 2000 tokens) as input to a language model to generate a brief, 20-token answer. Considering the widely adopted two-phase framework for inference, which statement best distinguishes the computational characteristics of processing the initial document versus generating the answer?

Analysis of the Two-Phase Inference Framework

A user submits a prompt to a large language model. Arrange the following events in the correct chronological order as they would occur within the standard two-phase inference framework.