Short Answer

Analysis of Ranking Error Penalties

A team is training a model to rank a list of 10 possible text completions. The training objective is to minimize a loss function defined as the negative log-probability of the ground-truth ranked sequence. The team observes that when the model incorrectly swaps the top two completions (placing the best at rank 2 and the second-best at rank 1), the penalty is much larger than when it incorrectly swaps the bottom two completions (placing the 9th-best at rank 10 and the 10th-best at rank 9). Analyze the mathematical structure of this loss function to explain this observation.

0

1

Updated 2025-09-26

Contributors are:

Who are from:

Tags

Ch.4 Alignment - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science