Learn Before
Adapting a Large Model on a Budget
A university research lab has a limited budget and access to a single server with two high-end GPUs. They plan to adapt a 70-billion parameter language model for a new task by updating all of the model's parameters for each of their planned experiments. Analyze the primary challenge this lab will face with their proposed approach and explain why this challenge necessitates considering alternative adaptation strategies.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A small startup with limited computational resources wants to customize a very large, general-purpose language model to handle specific queries for their niche e-commerce business. Their lead engineer proposes a plan to retrain all layers of the model on their custom dataset. Which of the following provides the most accurate evaluation of this proposal?
Adapting a Large Model on a Budget
The Scalability Problem of Model Adaptation