Learn Before
Evaluating Fine-Tuning Outcomes
A company fine-tunes a language model on a dataset of 1,000 specific 'how-to' questions and their answers for their software. After tuning, they test its performance. Analyze the results from Test Set A and Test Set B. Based on this analysis, has the model successfully generalized its ability to answer 'how-to' questions? Justify your reasoning by explaining what each test result indicates about the model's learning.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A development team adapts a pre-trained language model using a dataset of 5,000 customer support questions and their ideal answers. After this adaptation process is complete, they evaluate the model's performance. Which of the following outcomes provides the strongest evidence that the model has successfully generalized its ability to answer customer questions?
Evaluating Fine-Tuning Outcomes
Evaluating the Success of Model Adaptation