Learn Before
Calculating Ranking Probability
A probabilistic ranking model assigns a positive 'worth' score to three items: Item X (worth=8), Item Y (worth=4), and Item Z (worth=1). The model determines a full ranking by sequentially selecting the best item from the remaining set of options. The probability of an item being selected as best from a set is its worth divided by the sum of the worths of all items in that set. Calculate the exact probability of observing the specific ranking Y > X > Z. Show your calculation steps.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Applying the Plackett-Luce Model to RLHF Reward Modeling
Log-Probability of a Ranked Sequence
An AI team is using a probabilistic model to rank three generated summaries (A, B, C). The model assigns a positive 'strength' score to each summary. The probability of a summary being chosen as best from a given set of options is its strength score divided by the sum of the strength scores of all summaries in that set. This selection process is repeated to form a full ranking. Given the scores below, which statement is correct?
- Summary A Strength: 6.0
- Summary B Strength: 3.0
- Summary C Strength: 1.0
An AI system uses a probabilistic model to rank three generated text snippets: Snippet A, Snippet B, and Snippet C. The model assigns a positive 'worth' score to each snippet (A=9, B=6, C=3). The probability of a specific ranking is found by sequentially calculating the probability of choosing the best snippet from the remaining set of options. Arrange the following steps in the correct order to calculate the probability of the ranking A > B > C.
Calculating Ranking Probability