Recognizing High Bias on a Learning Curve
Question: Describe the usual learning-curve pattern when a model has high avoidable bias. Include what happens to training error, validation error, and the target performance level at the largest training-set size.
Sample answer: When a model has high avoidable bias, the training error remains much worse than the target performance level even after using the largest training set available. That means the model is still underperforming on the examples it has seen, which is a sign of strong bias. In this pattern, the validation error stays close to the training error, so the gap between them is small. A small train-validation gap suggests the model does not have much variance, even though its bias is high.
Key points:
- Training error stays well above the target performance level
- A large gap between training error and target performance indicates high bias
- The model still performs poorly on the training data
- Training and validation error remain close together
- A small train-validation gap indicates low variance
Rubric: A full-credit response must explain that, at the largest training-set size, training error is still far from the target performance level and that the train-validation gap is small. The answer should connect the first gap to high bias and the second gap to low variance.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
More Data Cannot Repair a Model That Still Underfits
Recognizing High Avoidable Bias from Learning Curves
A Small Train-Dev Gap Can Coexist with High Bias
If training error is still far above the best achievable error, the model has _____.
Interpreting Training and Validation Gaps
Steps for identifying strong underfitting from a learning curve
Recognizing High Bias on a Learning Curve
Diagnosing a Fraud Screening Model's Learning Curve
Meaning of a Small Training-Dev Error Gap
What Does the Reference Performance Represent?
High-Bias Models Usually Fit the Training Set Well