Learn Before
What signal indicates that the Eyeball dev set has become overfit?
Question: In one to three sentences, describe the signal that indicates an Eyeball dev set has become overfit.
Sample answer: The signal is that performance on the Eyeball dev set is much better than performance on the Blackbox dev set. This gap suggests the tuning process has been fitted to the specific examples in the Eyeball dev set rather than generalizing.
Key points:
- A large performance gap between Eyeball and Blackbox dev sets signals overfitting
- The Eyeball dev set performs much better than the Blackbox dev set in this case
Rubric: Full credit for identifying the performance gap between the Eyeball and Blackbox dev sets as the overfitting signal.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What does it mean if performance on the Eyeball dev set is much better than on the Blackbox dev set?
True or False: Overfitting the Eyeball dev set can be remedied by acquiring more data for it.
If performance on the Eyeball dev set is much better than the Blackbox dev set, you have _____ the Eyeball dev set.
Match each dev set performance scenario to its correct interpretation.
Order the steps for remedying an overfit Eyeball dev set.
Explain why acquiring more data helps remedy an overfit Eyeball dev set.
Diagnose and remedy a suspected overfit Eyeball dev set.
What signal indicates that the Eyeball dev set has become overfit?
Which action is recommended when the Eyeball dev set is found to be overfit?
True or False: A better performance on the Eyeball dev set than the Blackbox dev set is always a sign of a well-tuned model.