Why Make a Costly Architecture Change?
Question: Why might a machine learning engineer decide to significantly redesign a model architecture even when the change is hard to implement?
Sample answer: An engineer may accept the difficulty because an architectural redesign can be one of the few changes that improves both bias and variance at the same time, making the model better suited to the task.
Key points:
- Can reduce both bias and variance together
- Can make the model better matched to the problem
Rubric: Must state that architecture changes can simultaneously affect or reduce both bias and variance.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
How changing model structure can affect error sources
Architecture Changes Are as Predictable as Scaling
Architecture Changes Are Often _____
Ways to Improve a Neural Network
Trying Unusual Model Designs
Why Architecture Changes Can Be Powerful and Risky
Choosing a New Neural Network Design
Why Make a Costly Architecture Change?
Good Places to Find New Model Designs
Are Architecture Changes as Predictable as More Data?