Learn Before
A machine learning team fine-tunes a pre-trained language model on a new dataset of instructions. They use the default hyperparameters from a popular tutorial for a single training run. The resulting model performs poorly on their evaluation set. Based on the typical engineering process for this task, what is the most probable reason for the model's poor performance?
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Evaluating a Fine-Tuning Strategy
A machine learning team fine-tunes a pre-trained language model on a new dataset of instructions. They use the default hyperparameters from a popular tutorial for a single training run. The resulting model performs poorly on their evaluation set. Based on the typical engineering process for this task, what is the most probable reason for the model's poor performance?
A machine learning engineer is trying to optimize a language model for a specific task by adjusting its settings. Arrange the following steps into the logical, cyclical order that represents a single iteration of this experimental process.