What distinct purpose does each portion of the split dev set serve?
Question: Answer in one to three sentences, distinguishing the role of the manually examined portion from the role of the hands-off portion.
Sample answer: The manually examined portion supports error analysis, though it will be overfit more rapidly. The hands-off portion can be used to tune parameters and helps show when manual error analysis has caused overfitting to the examined portion.
Key points:
- Examined portion: manual error analysis.
- Unexamined portion: parameter tuning.
- The split helps detect overfitting of the examined portion.
Rubric: The answer should distinguish manual error analysis from hands-off parameter tuning and mention the examined portion's greater overfitting risk or the split's diagnostic value.
0
1
References
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Eyeball Dev Set
Blackbox Dev Set
Using the Entire Dev Set as the Eyeball Dev Set When It Is Too Small to Split
Why explicitly divide a large dev set into examined and unexamined portions?
Does manual examination make one dev subset more prone to overfitting?
The unexamined dev subset can be used to tune _____.
Match each dev-set concept with its role or consequence.
Order the reasoning for handling a large dev set with many errors.
Explain how an explicit dev-set split exposes overfitting from manual error analysis.
How should a team handle about 1,000 errors in a 5,000-example dev set?
What distinct purpose does each portion of the split dev set serve?
Which development pattern signals overfitting to the manually inspected subset?
Should a dev set that is too small to divide still be split into two portions?