Learn Before
A development team needs to accelerate the inference speed of a large, pre-trained language model for a task requiring a deep understanding of long-range dependencies and complex sentence structures. Which of the following strategies for reducing the model's size is most likely to severely degrade performance on this specific task?
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Evaluating Model Compression Strategies
A development team needs to accelerate the inference speed of a large, pre-trained language model for a task requiring a deep understanding of long-range dependencies and complex sentence structures. Which of the following strategies for reducing the model's size is most likely to severely degrade performance on this specific task?
A machine learning team is exploring different methods to reduce the size and inference time of a large language model based on the Transformer architecture. Match each pruning technique with its most likely description or primary impact.