Learn Before
The condition for a model to demonstrate intra-task generalization is expressed by the formula: Match each component of this formula to its correct description.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A research team is evaluating a language model's ability to generalize on the specific task of 'translating medical terminology from English to German'. The condition for successful generalization is met if the model's average performance on a set of new inputs exceeds a minimum threshold. This is represented by the formula: Where is the set of new inputs, is the performance score for a given input, and is the performance threshold.
The team tests the model on 5 new, unseen medical texts () and sets the minimum performance threshold at . The individual performance scores for the 5 texts are: [0.90, 0.95, 0.70, 0.80, 0.90].
Based on this data and the provided formula, which conclusion is correct?
The condition for a model to demonstrate intra-task generalization is expressed by the formula: Match each component of this formula to its correct description.
Evaluating Generalization Performance in a Real-World Scenario