Learn Before
Explain how the team's reward model differs in development from traditional reward models, and state the intended effect of their predefined bonus rule on the model's reasoning process.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Prep Sessions
Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Ch.3 Model Alignment and Safety - Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Model-Assisted Safety and Rule-Based Reward Models - Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
OpenStax Psychology (2nd ed.) Textbook
Related
A development team is using reinforcement learning to train a language model to be a helpful math tutor. To encourage the model to provide detailed, step-by-step solutions, they implement a simple reward rule: the model receives a higher reward for generating longer responses that include more mathematical equations. Which of the following describes the most significant potential flaw in this approach?
Analyzing a Heuristic Reward for a Debate LLM
Explain how the team's reward model differs in development from traditional reward models, and state the intended effect of their predefined bonus rule on the model's reasoning process.