Explain why standard overfitting and underfitting terminology is difficult to apply to a classifier with high bias and high variance.
Question: Based on Andrew Ng's Machine Learning Yearning course, explain why standard overfitting and underfitting terminology is difficult to apply to a classifier with 15% estimated bias and 15% estimated variance. Detail its performance on both training and dev sets in your explanation.
Sample answer: Standard overfitting and underfitting terminology is difficult to apply because a classifier with 15% estimated bias and 15% estimated variance is simultaneously overfitting and underfitting. It underfits because it performs poorly on the training set, indicating high bias. At the same time, it overfits because its performance on the dev set is even worse, showing high variance. Since both phenomena occur at the same time, neither term alone suffices to describe the classifier's state.
Key points:
- The classifier is simultaneously overfitting and underfitting.
- Poor performance on the training set indicates high bias.
- Even worse performance on the dev set indicates high variance.
Rubric: The response must explain that the classifier is simultaneously overfitting and underfitting, detail that it performs poorly on the training set (indicating high bias), and explain that its performance is even worse on the dev set (indicating high variance).
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
Which statement best describes a classifier with an estimated 15% bias and 15% variance?
True or False: The overfitting/underfitting terminology applies clearly when a classifier has both high bias and high variance.
A classifier with high bias performs _____ on the training set.
Match each term to its defining characteristic in Andrew Ng's high bias/high variance scenario.
Order the steps to determine whether a classifier has high bias, high variance, or both.
In Andrew Ng's high bias/high variance example in Machine Learning Yearning, what are the two estimated error values?
True or False: A classifier with both high bias and high variance is simultaneously overfitting and underfitting.
In Andrew Ng's example, both the estimated bias and estimated variance are _____.
Match each classifier performance pattern to its error diagnosis.
Order the reasoning steps Andrew Ng uses to conclude a classifier has both high bias and high variance.
Explain why standard overfitting and underfitting terminology is difficult to apply to a classifier with high bias and high variance.
Diagnosing a Classifier with 15% Training Error and 30% Dev Error
How does a classifier with high bias and high variance perform on the training and dev sets?