Learn Before
Evaluating a Fine-Tuning Strategy
Based on the provided case study, critically evaluate the startup's approach. Justify your assessment by identifying potential risks and explaining why this process is unlikely to yield an optimal result.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Evaluating a Fine-Tuning Strategy
A machine learning team fine-tunes a pre-trained language model on a new dataset of instructions. They use the default hyperparameters from a popular tutorial for a single training run. The resulting model performs poorly on their evaluation set. Based on the typical engineering process for this task, what is the most probable reason for the model's poor performance?
A machine learning engineer is trying to optimize a language model for a specific task by adjusting its settings. Arrange the following steps into the logical, cyclical order that represents a single iteration of this experimental process.