Learn Before
Identifying the Indicator of Dev Set Overfitting
Question: After concluding the development of your algorithm, what specific performance comparison serves as a sign that your algorithm has overfit to the dev set?
Sample answer: Dev-set overfitting is indicated when you evaluate your completed system and find that the dev set performance is much better than the test set performance.
Key points:
- Compare dev set performance to test set performance.
- Dev set performance being much better is the sign of overfitting.
Rubric: The answer must mention comparing dev set and test set performance, noting that the former being significantly higher is the key indicator.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
Avoiding Test Set Decisions During Regular Progress Tracking
What causes an algorithm to gradually overfit to the dev set during the development process?
If dev set performance is much better than test set performance after development, this is a sign of dev-set overfitting.
When dev set performance is much better than test set performance, Machine Learning Yearning recommends you get a _____ dev set.
Match each concept related to dev-set overfitting to its correct description.
Arrange the steps of the full dev-set overfitting lifecycle in the correct order.
After development, your dev set performance is far better than your test set performance. What does Machine Learning Yearning recommend?
According to Machine Learning Yearning, you should regularly evaluate your algorithm on the test set throughout development to track progress.
The process of repeatedly evaluating ideas on the dev set causes your algorithm to gradually _____ to the dev set.
Match each verbatim phrase from Machine Learning Yearning to what it refers to or signifies.
Arrange the reasoning steps for diagnosing and responding to a dev-test performance gap in the correct order.
Analyzing the Cause and Solution for Dev Set Overfitting
Diagnosing a Performance Gap After Development
Identifying the Indicator of Dev Set Overfitting