Short Answer

Applying the Listwise Loss Summation

A human annotator is given a prompt x\mathbf{x} and three possible responses: yA\mathbf{y}_A, yB\mathbf{y}_B, and yC\mathbf{y}_C. The annotator provides a ranked list YY where the preference order is yAyByC\mathbf{y}_A \succ \mathbf{y}_B \succ \mathbf{y}_C. Based on the summation part of the listwise loss formula, yaY,ybYyayblogPr(yaybx)\sum_{\substack{\mathbf{y}_a\in Y, \mathbf{y}_b\in Y \\ \mathbf{y}_a\neq \mathbf{y}_b}} \log\Pr(\mathbf{y}_a \succ \mathbf{y}_b|\mathbf{x}), list all the individual log probability terms that would be summed up for this specific ranked list YY.

0

1

Updated 2025-10-04

Contributors are:

Who are from:

Tags

Ch.4 Alignment - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Application in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science