Normalizing a Function to Create a Probability Distribution
To transform a function that is not a probability distribution into one, it can be treated as an unnormalized probability. For instance, a term like exp(r(x, y)) within an objective function can be converted into a valid, normalized probability distribution by dividing it by a normalization factor. This factor is calculated by summing or integrating the unnormalized function over its entire domain, ensuring the resulting distribution sums to one.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
A machine learning model is being trained to generate outputs. Its behavior is described by a probability distribution
p_model(y|x), and the desired behavior is captured by a target data distributionp_data(y|x). The training process involves minimizing an objective function. Which of the following objective function structures is most desirable because it can be clearly interpreted as a measure of the 'distance' or difference between the two distributions?Critique of an Objective Function Formulation
Evaluating Objective Function Designs
Learn After
Normalization Factor for a Reward-Weighted Policy
A function assigns the following unnormalized scores to three possible discrete outcomes:
score(A) = 12,score(B) = 7, andscore(C) = 1. To transform these scores into a valid probability distributionP(outcome), each score must be divided by a normalization factor calculated from the sum of all scores. What is the resulting probability for outcome B,P(B)?From Model Scores to Probabilities
Converting Model Scores to Probabilities
Learn After
Normalization Factor for a Reward-Weighted Policy
A function assigns the following unnormalized scores to three possible discrete outcomes:
score(A) = 12,score(B) = 7, andscore(C) = 1. To transform these scores into a valid probability distributionP(outcome), each score must be divided by a normalization factor calculated from the sum of all scores. What is the resulting probability for outcome B,P(B)?From Model Scores to Probabilities
Converting Model Scores to Probabilities
Related
A machine learning model is being trained to generate outputs. Its behavior is described by a probability distribution
p_model(y|x), and the desired behavior is captured by a target data distributionp_data(y|x). The training process involves minimizing an objective function. Which of the following objective function structures is most desirable because it can be clearly interpreted as a measure of the 'distance' or difference between the two distributions?Critique of an Objective Function Formulation
Evaluating Objective Function Designs