Indicator of High Variance from Error Sets
Question: If a model's optimal error rate is about 0% and its training error is 1%, what specific error rate on the training-dev set in the provided scenario indicates that the model has high variance?
Sample answer: A training-dev error rate of 5% indicates that the model has high variance when compared to the 1% training error.
Key points:
- 5% training-dev error.
- The gap between 1% training error and 5% training-dev error indicates the variance.
Rubric: The answer must explicitly identify the 5% error rate on the training-dev set.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What primary problem does a model with 1% training error and 5% training-dev error exhibit when optimal error is ~0%?
True or False: When training error is 1%, training-dev error is 5%, and optimal error is ~0%, the algorithm primarily has high bias.
When training error is 1% and training-dev error is 5%, with near-zero optimal error, the algorithm has high _____.
Match each error metric to its role in diagnosing high variance in the cat detection scenario.
Order the steps for diagnosing the primary error type when given training, training-dev, and dev error values.
Which gap in the error analysis directly signals high variance in a model with 1% training error, 5% training-dev error, and 5% dev error?
True or False: In the ML Yearning cat detection example used to illustrate high variance, the dev error and training-dev error are both 5%.
The avoidable _____ is only ~1% in this scenario because training error (1%) is very close to optimal error (~0%).
Match each diagnostic gap to the problem type it reveals in the cat detection error analysis.
Order the reasoning steps that lead to the conclusion 'this model has high variance' given the cat detection error values.
Analyzing High Variance Using Training and Training-Dev Error Rates
Diagnosing Variance in a Cat-Detection Algorithm
Indicator of High Variance from Error Sets