Learn Before
Role and Output of a Learned Verifier
An AI development team is building a system to automatically assess the quality of different responses generated by a language model. They train a separate model on a dataset of human preference judgments (e.g., 'Response A is better than Response B'). Explain the specific role of this separately trained model and describe the nature of its output when it evaluates a new response.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Improving AI-Generated Summaries
An AI development team has created a dataset by having human experts rank several machine-generated summaries for a set of articles, from best to worst. The team's goal is to create an automated system that can assign a quality score to any new summary for any new article. Which of the following approaches best utilizes the collected data to achieve this specific goal?
Role and Output of a Learned Verifier