Case Study

PGR Calculation Scenario

A research team is developing a new model. Their initial, 'weak' model achieves an accuracy of 50% on a specific classification task. They have a more powerful, 'strong' model architecture which, if trained on a perfect dataset, could theoretically reach a 'ceiling' accuracy of 90%. To save on labeling costs, they use the weak model to supervise the training of the strong model. After this process, the newly trained strong model achieves an accuracy of 80%. Based on this scenario, calculate the Performance Gap Recovered (PGR).

0

1

Updated 2025-10-02

Contributors are:

Who are from:

Tags

Ch.4 Alignment - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Application in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science