Learn Before
Analyzing a Model Adaptation Strategy
A machine learning team is adapting a large language model for a new, specialized task. They decide to use an approach where the entire set of the model's original parameters is updated during training on the new data. Describe the main advantage and the main disadvantage of this specific adaptation strategy.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Computational Cost of Standard Fine-Tuning
A team is adapting a large, pre-trained language model for a specialized task: summarizing legal documents. They choose an adaptation strategy that involves re-training on the legal dataset and allowing every single parameter within the original model to be updated during this process. Which statement best analyzes a direct consequence of this specific approach?
Evaluating a Model Adaptation Strategy
Motivation for Parameter-Efficient Fine-Tuning
Analyzing a Model Adaptation Strategy