Notation for Predicted Output During Fine-Tuning
In the fine-tuning process, the predicted output generated by the model using the parameters that are currently being optimized is denoted as . The symbol represents the set of parameters that were initialized from the pre-trained model and are being actively updated.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Mathematical Formulation of the Supervised Fine-Tuning Objective
A machine learning engineer is performing supervised fine-tuning on a pre-trained language model. The process involves three distinct states for the model's parameters:
- The initial parameters loaded from the pre-trained model before any new training begins.
- The parameters as they are being iteratively updated by the optimization algorithm on the new dataset.
- The final, converged parameters after the fine-tuning process is complete.
Which option correctly maps the standard notation to these three states?
Notation for Predicted Output During Fine-Tuning
In the mathematical description of a model fine-tuning process, different symbols are used to represent the model's parameters at various stages. Match each symbol with its correct description.
Correcting Fine-Tuning Parameter Notation
Optimal Parameters Formula in Fine-Tuning
Learn After
A large language model is undergoing a fine-tuning process. The process starts with a set of pre-trained parameters, and these parameters are being actively updated through optimization. At a given step during this optimization, the model generates an output. Which of the following notations correctly represents this specific output?
Interpreting Fine-Tuning Notation
In the context of fine-tuning a large language model, the notation is used to represent the model's final, fully optimized prediction after the entire training process is complete.