Google

The specific prediction, ŷ, made by a model is formally determined by an optimization rule that operates on an objective function. For instance, in probabilistic classification models, the prediction is the class 'y' that maximizes the conditional probability P(y|x), expressed as ŷ = argmax_y P(y|x). The 'arg' operator (argmax for maximization, argmin for minimization) identifies the input value that achieves the optimal value of the function.

Prediction via Optimization

In certain training methodologies, the target for the learning process is generated by the model itself rather than being a pre-existing ground truth label. This involves identifying the output that maximizes an objective function, such as a log-probability. This optimized output is then used as the target for a loss function, which in turn guides the model's parameter updates.

Using Optimized Predictions as Learning Targets

The fundamental principle for making a prediction in many machine learning models is to select the output that has the highest probability given an input. This is formally expressed as: $$\hat{y} = \underset{y \in Y}{\arg\max}\, \text{Pr}(y|x)$$ In this formula, $x$ is the input, $Y$ is the set of all possible outputs, $y$ is a candidate output from that set, and $\hat{y}$ is the final predicted output. The prediction $\hat{y}$ is chosen because it maximizes the conditional probability $\text{Pr}(y|x)$.

General Formula for Prediction via Maximum Probability

A team is developing a language model for two distinct tasks. For Task A, a medical information bot, the model must provide the most factually accurate and reliable information. For Task B, a creative story generator, the model needs to produce diverse and interesting narratives. The team implements a prediction rule for both tasks where the model always selects the single word with the highest calculated probability to be the next word in a sequence. 

Analyze the suitability of this prediction rule for both Task A and Task B. Explain why this rule might be highly effective for one task but lead to undesirable results in the other.

Evaluating a Prediction Strategy

Based on the system's decision rule and the calculated probabilities, what classification will the system assign to the new email? Explain your reasoning.

Spam Filter Classification

The predicted value, denoted as $$\hat{y}$$, is formally determined as the argument that optimizes a specific objective function. This is expressed in the general form:
$$\hat{y} = \text{arg } \dots$$
where $$\text{arg}$$ typically represents either $$\text{arg min}$$ (argument of the minimum) or $$\text{arg max}$$ (argument of the maximum). The choice between $$\text{arg min}$$ and $$\text{arg max}$$ depends on whether the objective is to minimize a loss function or maximize a likelihood function, respectively.

Formal Definition of the Predicted Value (ŷ)

A language model is given the input 'The ocean is...' and calculates the conditional probability for four candidate words to be the next word. Based on the values below, which word would a model that predicts by maximizing probability choose?

- P("deep" | "The ocean is...") = 0.75
- P("cold" | "The ocean is...") = 0.15
- P("running" | "The ocean is...") = 0.09
- P("quiet" | "The ocean is...") = 0.01

Learn Before

Related