Learn Before
Evaluating a Preference Model's Suitability
Evaluate the appropriateness of the team's proposed modeling approach for this specific dataset. Justify your conclusion.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Modeling Preference Probability with the Bradley-Terry Model in RLHF
Plackett-Luce Model for Listwise Ranking
Evaluating a Preference Model's Suitability
A research team is developing a system to determine the best-tasting coffee blend. They collect data by presenting human tasters with two different blends at a time and asking them to choose which one they prefer. The team wants to use this data to build a probabilistic model that can predict the likelihood of one blend being chosen over another. Which of the following modeling approaches is most directly suited for this specific data collection method and goal?
Notation for a List of Outputs in Ranking
Evaluating a Model's Assumptions in a Dynamic Context