Learn Before
Select the right remedy for bias and variance in two projects.
Case context: Project North has been diagnosed with high avoidable bias in its neural network. Project South has been diagnosed with high variance in its system.
Question: Using the simple remediation formula, what should each project do, and why?
Sample answer: Project North should increase model capacity, for example by adding layers or hidden units, because the diagnosis is high avoidable bias. Project South should collect more training examples because the diagnosis is high variance.
Key points:
- Project North should use a larger model.
- Adding layers or hidden units is a valid example for Project North.
- Project South should add more training data.
- Each recommendation must match the diagnosed problem.
Rubric: The response should assign a larger model to Project North and more training data to Project South, with each recommendation tied to the correct diagnosis.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Why enlarging a model can lower bias
Using More Data When Variance Is High
Why Increasing Model Size and Data Eventually Stops Helping
Methods to Reduce High Avoidable Bias
Ways to Reduce High Variance
What should you do when avoidable bias is high?
True or false: When a model has high variance, adding more training examples is often a useful remedy.
For persistent underfitting, increase the _____ of the model.
Match each learning problem or model change with the usual remedy or meaning.
Order the steps for applying a simple model-fix rule.
How the diagnosis determines the fix for bias and variance
Select the right remedy for bias and variance in two projects.
State the recommended fix for each training problem.
Which option applies the rule of thumb correctly to both cases?
Bias and variance call for the same fix