Learn Before
Preference for Divergence-Based Objective Functions
In designing objective functions, a structure that represents the difference between two probability distributions is often preferred. This form is conceptually advantageous because it can be interpreted as a divergence, which measures the 'distance' or difference between the two distributions. This contrasts with less ideal forms, such as the difference between a log-probability distribution and another arbitrary function, which lack this clear interpretation.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Components of Karim's Constrained Choice Problem
Formulating Karim's Constrained Optimization Problem
A farmer plans to grow two types of crops: wheat (W, measured in bushels) and corn (C, measured in bushels). The farmer's primary goal is to achieve the highest possible profit from their land. The market price gives a profit of $5 per bushel of wheat and $8 per bushel of corn. The farmer faces limitations on available land and water. Given this situation, which of the following expressions represents the farmer's objective function?
Formulating an Objective Function for a Diet Plan
Analyzing a Business Decision
In any problem where a decision-maker faces limitations on their choices, the function representing the goal they are trying to optimize must be a quantity they wish to maximize.
Evaluating Competing Policy Objectives
A decision-maker faces a problem where they must make a choice under certain limitations. Match each decision-maker's scenario with the correct mathematical expression that represents their primary goal.
A city's transportation department is designing a new public bus system. Their main goal is to reduce the average commute time for its citizens, but they must work within a specific budget and a limited number of buses. The mathematical formula that represents the average commute time, which the department is trying to minimize, is referred to as the ______.
A city planner is trying to determine the optimal allocation of funds between building new parks and repairing existing roads. The goal is to maximize the overall well-being of the city's residents, subject to a fixed annual budget. To solve this as a formal optimization problem, the planner must follow a series of logical steps. Arrange the following steps in the correct logical order for setting up this problem.
Evaluating a Public Health Objective Function
Interpreting a Firm's Objective
Prediction via Optimization
Preference for Divergence-Based Objective Functions
Learn After
Normalizing a Function to Create a Probability Distribution
A machine learning model is being trained to generate outputs. Its behavior is described by a probability distribution
p_model(y|x), and the desired behavior is captured by a target data distributionp_data(y|x). The training process involves minimizing an objective function. Which of the following objective function structures is most desirable because it can be clearly interpreted as a measure of the 'distance' or difference between the two distributions?Critique of an Objective Function Formulation
Evaluating Objective Function Designs