Learn Before
Explain why a model can show both underfitting and overfitting at the same time.
Question: A fraud classifier has 14% error on the training set and 21% error on the development set. Explain why it is not accurate to describe this model as only underfitting or only overfitting. Include the meaning of its training and development performance in your response.
Sample answer: This model shows signs of both problems at once. The training error is still fairly high, which suggests the model is not fitting the training data well enough and therefore has high bias. The development error is even higher, which suggests the model is also failing to generalize well and has high variance. Because both indicators are present, a single label such as only underfitting or only overfitting does not fully describe the model.
Key points:
- The model shows both underfitting and overfitting symptoms.
- High training error indicates poor fit to the training data and suggests high bias.
- Higher development error shows weaker generalization and suggests high variance.
Rubric: The response must explain that the classifier shows both underfitting and overfitting, state that the training error is high enough to indicate poor fit/high bias, and state that the development error is worse, indicating high variance and weak generalization.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
A classifier shows about 15% bias and 15% variance. Which description fits best?
True or False: When a classifier shows both high bias and high variance, the usual overfitting/underfitting labels do not cleanly describe the situation.
A classifier with high bias usually performs _____ on the training data.
Identify the Bias and Variance Pattern
Put the diagnostic steps in order for deciding whether a model has high bias, high variance, or both.
In the worked bias–variance diagnosis, what were the two estimated error rates?
True or False: A model that has both high bias and high variance can be overfitting and underfitting at the same time.
Equal Bias and Variance in a Fraud Detector
Match each model-performance pattern to the most likely diagnosis.
Reasoning About Bias and Variance From Training and Validation Results
Explain why a model can show both underfitting and overfitting at the same time.
Diagnosing a Fraud Model with 12% Training Error and 27% Dev Error
What happens when a model has both high bias and high variance?