Correcting Fine-Tuning Parameter Notation
A machine learning researcher is documenting their fine-tuning experiment. They write the following summary:
'We began the optimization process with the parameters denoted as . At each step, we updated the parameters to minimize the loss. After the process converged, we saved the final model parameters, which we denote as .'
Identify the three notational errors in this summary and explain what each incorrect symbol should be replaced with.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models Course
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Mathematical Formulation of the Supervised Fine-Tuning Objective
A machine learning engineer is performing supervised fine-tuning on a pre-trained language model. The process involves three distinct states for the model's parameters:
- The initial parameters loaded from the pre-trained model before any new training begins.
- The parameters as they are being iteratively updated by the optimization algorithm on the new dataset.
- The final, converged parameters after the fine-tuning process is complete.
Which option correctly maps the standard notation to these three states?
Notation for Predicted Output During Fine-Tuning
In the mathematical description of a model fine-tuning process, different symbols are used to represent the model's parameters at various stages. Match each symbol with its correct description.
Correcting Fine-Tuning Parameter Notation
Optimal Parameters Formula in Fine-Tuning