Google

In the context of a Large Language Model (LLM), predictive inference involves selecting an output $\hat{y}$ by optimizing the model's probability distribution. This is formally expressed by combining the general prediction formula, which starts as $\hat{y} = \text{arg...}$, with the specific probability function of the model, denoted as $\text{LLM Pr}_\theta^s(\cdot)$. In this notation, $\theta$ represents the model's parameters, and the superscript `s` may refer to a specific scoring method.

Predictive Inference in Large Language Models

A large language model, with a fixed set of parameters `θ` and using a specific scoring method `s`, is performing an inference task. Its goal is to select the single most probable output `ŷ` from the entire space of possible outputs `y`. Which mathematical expression correctly represents this process?

Given the following scenario, determine the model's predicted output (ŷ) and explain the reasoning behind the selection process.

Applying Predictive Inference

Consider the formal expression for predictive inference in a large language model:  
`ŷ = argmax_y LLM Pr_θ^s(y)`  

Deconstruct this expression by explaining the specific role and significance of each of the following three components in determining the final output `ŷ`:  
1. `argmax_y`  
2. `LLM Pr(y)`  
3. `θ` and `s`

Learn Before

Related