Diagnosing a Language Model's Training Plateau
Analyze the team's training methodology. What is the most significant limitation of their feedback mechanism that is likely contributing to this performance plateau, and why does it prevent the model from achieving higher levels of quality?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A team is training a language model to generate helpful responses. They are considering two different feedback mechanisms to guide the training process:
- Mechanism A: A classifier that labels each generated response as either 'Good' or 'Bad'.
- Mechanism B: A scoring model that assigns each generated response a numerical score from 1 to 10, representing its degree of quality.
Which statement best analyzes the fundamental advantage of using Mechanism B over Mechanism A for refining the language model's performance?
Diagnosing a Language Model's Training Plateau
Evaluating a Change in a Model's Feedback Mechanism