Learn Before
Choose remedies for a model that performs poorly on its training set.
Case context: A team finds that its learning algorithm is doing poorly on the training set. Error analysis also reveals a particular recurring category of errors. The team is considering a larger model, new features, weaker regularization, a revised architecture, or more training data.
Question: What should the team diagnose, which interventions are supported, and which proposed intervention should not be relied upon to solve the diagnosed problem?
Sample answer: The team should diagnose high avoidable bias. It can increase model size to improve training-set fit, create input features based on the recurring error category, reduce or eliminate regularization while recognizing that variance may increase, or modify the architecture to better suit the problem. It should not rely on more training data to reduce bias because additional data helps variance and usually has no significant effect on bias.
Key points:
- Poor training-set performance indicates high avoidable bias.
- A larger model is a supported intervention.
- Error analysis can motivate useful feature changes.
- Reducing regularization can increase variance.
- Architecture modification may affect both bias and variance.
- More data is not a helpful high-bias technique.
Rubric: The response should diagnose high avoidable bias, identify the four supported intervention categories, connect feature modification to error analysis, mention the variance tradeoff of reducing regularization, and reject more data as the main bias remedy.
0
1
References
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Modifying Input Features Based on Error Analysis to Reduce Avoidable Bias
Reducing or Eliminating Regularization to Reduce Avoidable Bias
Which intervention directly targets high avoidable bias by improving training-set fit?
Adding more training data usually has no significant effect on avoidable bias.
Complete the remedy: Reduce or eliminate _____ to lower avoidable bias.
Match each intervention with its stated effect or rationale.
Order the reasoning process for responding to poor training-set performance.
Explain how the four recommended techniques address high avoidable bias.
Choose remedies for a model that performs poorly on its training set.
Why can reducing regularization help a high-bias model?
Which response best uses error analysis to reduce avoidable bias?
Changing model architecture may influence both bias and variance.