Learn Before
Concept

Separating Input and Output Variables in LLM Formulation

Although the input and output tokens of a Large Language Model can technically be viewed as sub-sequences of a single, continuous sequence, it is common practice to employ separate variables—typically x\mathbf{x} for the input and y\mathbf{y} for the output. Adopting this distinct notation helps to clearly separate the given context from the generated text, resulting in mathematical formulations that closely resemble those used in other natural language processing text generation models, such as neural machine translation.

0

1

Updated 2026-04-19

Contributors are:

Who are from:

Tags

Foundations of Large Language Models

Ch.2 Generative Models - Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences