Learn Before
Selecting a Model Adaptation Strategy
Based on the provided scenario, propose the most suitable method for adapting the pre-trained model to this specific task. Justify your recommendation by explaining how it addresses the startup's key constraints and why other common methods would be less appropriate.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Selecting a Model Adaptation Strategy
Comparing Model Adaptation Techniques
A research lab has access to a single, very large, pre-trained language model with billions of parameters. Their goal is to adapt this model for over a dozen distinct, specialized scientific text analysis tasks (e.g., gene name recognition, chemical reaction classification, protein function prediction). They have limited computational resources and cannot afford to store a separate, multi-billion parameter model for each of the dozen tasks. Which of the following adaptation approaches best addresses their primary constraints?