Analyzing the Computational Demands of Fine-Tuning
A machine learning team is fine-tuning a large language model with 175 billion parameters. Explain the two primary factors inherent in this process that contribute to its significant computational expense, relating each factor to the specific hardware resources required.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Ch.4 Alignment - Foundations of Large Language Models
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Optimization Strategies for Fine-Tuning
Assessing the Viability of a Model Update Strategy
A technology startup has successfully pre-trained a large language model with several hundred billion parameters. Their business plan involves continuously improving the model by fine-tuning it on new, specialized datasets every month. Which of the following statements best analyzes the primary reason this continuous fine-tuning strategy would be exceptionally resource-intensive?
Analyzing the Computational Demands of Fine-Tuning