Learn Before
Analysis of the Two-Phase Inference Framework
Describe the two distinct phases of the common framework used for generating output from a large language model. In your answer, explain the primary function of each phase and analyze why separating the process into these two stages is a fundamental approach for model inference.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Search (Decoding) Algorithms for LLM Inference
Establishing the Initial Context for Inference
A user provides a large document (e.g., 2000 tokens) as input to a language model to generate a brief, 20-token answer. Considering the widely adopted two-phase framework for inference, which statement best distinguishes the computational characteristics of processing the initial document versus generating the answer?
Analysis of the Two-Phase Inference Framework
A user submits a prompt to a large language model. Arrange the following events in the correct chronological order as they would occur within the standard two-phase inference framework.