Learn Before
An AI team is using a probabilistic model to rank three generated summaries (A, B, C). The model assigns a positive 'strength' score to each summary. The probability of a summary being chosen as best from a given set of options is its strength score divided by the sum of the strength scores of all summaries in that set. This selection process is repeated to form a full ranking. Given the scores below, which statement is correct?
- Summary A Strength: 6.0
- Summary B Strength: 3.0
- Summary C Strength: 1.0
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Applying the Plackett-Luce Model to RLHF Reward Modeling
Log-Probability of a Ranked Sequence
An AI team is using a probabilistic model to rank three generated summaries (A, B, C). The model assigns a positive 'strength' score to each summary. The probability of a summary being chosen as best from a given set of options is its strength score divided by the sum of the strength scores of all summaries in that set. This selection process is repeated to form a full ranking. Given the scores below, which statement is correct?
- Summary A Strength: 6.0
- Summary B Strength: 3.0
- Summary C Strength: 1.0
An AI system uses a probabilistic model to rank three generated text snippets: Snippet A, Snippet B, and Snippet C. The model assigns a positive 'worth' score to each snippet (A=9, B=6, C=3). The probability of a specific ranking is found by sequentially calculating the probability of choosing the best snippet from the remaining set of options. Arrange the following steps in the correct order to calculate the probability of the ranking A > B > C.
Calculating Ranking Probability