How to Spot High Variance from a Gap in Errors
Question: Suppose a model has about 0% attainable error, its training error is 1%, and its training-dev error is 5%. Which error measurement shows that the model is suffering from high variance?
Sample answer: The 5% error on the training-dev set is the signal of high variance.
Key points:
- Training error is only 1%.
- Training-dev error rises to 5%.
- The larger gap points to a variance problem.
Rubric: The answer must explicitly state the 5% training-dev error rate.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What main issue is suggested by 2% training error and 6% training-dev error when the best possible error is near 0%?
True or False: If training error is 2%, training-dev error is 9%, and the best achievable error is near 0%, the main issue is high bias.
A large gap between training error and training-dev error, with near-zero optimal error, indicates high _____.
Match the Error Metrics in a Variance Check
Order the steps for identifying the main error source when given training, training-dev, and dev error values.
Which gap points most directly to high variance when training error is 2%, training-dev error is 6%, and dev error is 6%?
True or False: In a diagnostic example of high variance, the model has 2% training error, 6% training-dev error, and 6% dev error.
The avoidable _____ is about 1% here because the training error (2%) is close to the best achievable error (~1%).
Match each diagnostic gap to the model issue it reveals in a retail demand forecast analysis.
Order the reasoning steps that support the conclusion that this model has high variance.
Interpreting Training and Training-Dev Errors for Variance
Diagnosing Variance in a Warehouse Package Sorter
How to Spot High Variance from a Gap in Errors