Learn Before
Model Deployment Decision for a Mobile Application
Based on the scenario below, evaluate the company's decision to use the smaller, parameter-reduced model for their mobile app. Justify your conclusion by weighing the primary advantage against the main disadvantage in the context of this specific application.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Model Deployment Decision for a Mobile Application
A development team is optimizing a large language model for deployment on devices with limited memory. They apply a technique that identifies and permanently removes 40% of the model's parameters deemed least important to its performance. Which of the following outcomes represents the most probable trade-off the team will encounter?
When applying pruning to a large language model, the less important parameters are temporarily ignored during the inference process to speed up computation, but they remain part of the model's file.