Why are architecture changes hard to use for reducing both bias and variance?
Question: Why is it often difficult to choose a model-architecture change that lowers both bias and variance at the same time?
Sample answer: Because useful architecture changes are often hard to discover, hard to implement correctly, and hard to tune for the specific dataset and task. A design that works well for one problem may not transfer well to another.
Key points:
- Architecture changes can be difficult to identify.
- They can be difficult to implement and tune.
- The best architecture depends on the task and data.
Rubric: The student should explain that architecture changes are hard to find and implement, and that selecting an architecture well matched to the task is difficult.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Which change can lower both bias and variance?
Methods That Improve Both Bias and Variance
How a well-matched architecture can improve both errors
Match architecture choices with their effects
Sequence of steps for reducing both kinds of error with architecture changes
How architecture changes can lower bias and variance together
Choosing a New Model Design for a Forecasting Task
Why are architecture changes hard to use for reducing both bias and variance?
What can happen when you choose a model architecture that matches the task?
Major architecture changes can reduce both bias and variance