Consider the following formula for a loss function used to train a model on ranked lists of outputs, where N is the number of items in a given list Y:
What is the primary analytical consequence of including the normalization term in this calculation?
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Consider the following formula for a loss function used to train a model on ranked lists of outputs, where
Nis the number of items in a given listY:What is the primary analytical consequence of including the normalization term in this calculation?
Applying the Listwise Loss Summation
Consider the listwise loss formula used for training on ranked preferences:
True or False: If a model is completely uncertain about the preferences within a ranked list (i.e., it assigns for all distinct pairs), the contribution of that specific list to the overall loss will be zero.