Evaluating Policy Effectiveness
A research team is training two different policies, Policy A and Policy B, for a text-generation agent. The effectiveness of each policy is measured by a performance function, , which calculates the expected cumulative reward. After the training process is complete, the team obtains the following results:
- Policy A: The final set of parameters results in a performance function value of .
- Policy B: The final set of parameters results in a performance function value of .
Based on the fundamental objective of this training approach, which policy should be considered more successful? Justify your answer by explaining the relationship between the performance function's value and the training goal.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Optimal Policy Parameters via Maximization Formula
An engineer is training a system using a reinforcement learning approach. The system's behavior is determined by a set of adjustable parameters. The training process aims to find the parameter values that maximize a specific 'performance function,' which represents the expected cumulative reward. The engineer runs two separate training procedures, Procedure X and Procedure Y, and observes the following final outcomes:
- Procedure X: The final set of parameters results in a performance function value of 150.
- Procedure Y: The final set of parameters results in a performance function value of 125. However, Procedure Y completed in half the time of Procedure X.
Which statement best evaluates the outcomes in relation to the primary training objective?
Evaluating Policy Effectiveness
Identifying Optimal Policy Parameters from Training Data
Basic Policy Gradient Approach