Learn Before
The Objective of Reinforcement Learning from Human Feedback
In the context of training a language model using a methodology based on reinforcement learning and human feedback, describe the central objective the model is trained to achieve. What does it seek to maximize, and where does the signal for this maximization originate?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Comprehension in Revised Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An AI development team is refining a language model. Their process involves showing human reviewers two different model-generated responses to the same prompt and asking them to select the better one. This preference data is then used to further train the model. What is the fundamental goal of this training methodology?
The central objective of Reinforcement Learning from Human Feedback (RLHF) is to train a language model to produce the most factually correct and verifiable information.
The Objective of Reinforcement Learning from Human Feedback