Learn Before
How the diagnosis determines the fix for bias and variance
Question: In a short analytical response, explain how a simple bias/variance diagnosis leads to different remedies for each problem.
Sample answer: The diagnosis points to different actions depending on the source of the error. If a model has high avoidable bias, a common response is to make the model more expressive, for example by adding more layers or hidden units to a neural network. If the model has high variance, a common response is to expand the training set so the model sees more examples. In other words, the remedy depends on whether the main issue is bias or variance.
Key points:
- High avoidable bias is addressed by increasing model capacity.
- Adding layers or hidden units is one way to increase neural-network capacity.
- High variance is addressed by using more training data.
- The appropriate fix depends on which problem is diagnosed.
Rubric: A strong response correctly matches each problem with its remedy, gives a valid example of increasing model capacity, and clearly states that the choice of action depends on the diagnosis.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Why enlarging a model can lower bias
Using More Data When Variance Is High
Why Increasing Model Size and Data Eventually Stops Helping
Methods to Reduce High Avoidable Bias
Ways to Reduce High Variance
What should you do when avoidable bias is high?
True or false: When a model has high variance, adding more training examples is often a useful remedy.
For persistent underfitting, increase the _____ of the model.
Match each learning problem or model change with the usual remedy or meaning.
Order the steps for applying a simple model-fix rule.
How the diagnosis determines the fix for bias and variance
Select the right remedy for bias and variance in two projects.
State the recommended fix for each training problem.
Which option applies the rule of thumb correctly to both cases?
Bias and variance call for the same fix