Learn Before
When is it worth fixing mislabeled validation examples?
Question: In one to three sentences, explain the condition under which correcting mislabeled validation labels is worth the effort.
Sample answer: It is worth correcting them when the label errors are large enough to make validation checks slow or unreliable. In particular, if the mistakes can change which model appears better, they should be fixed.
Key points:
- The errors must interfere with the validation set's purpose.
- That purpose includes fast evaluation and comparing models.
Rubric: The answer must identify impaired evaluation or model comparison as the reason to correct the labels.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Why mislabeled development examples matter more as models improve
When should mislabeled development-set examples be fixed?
When to Repair Validation Labels
Noisy labels can ____ the comparison itself.
Match each development-set concept to its role in deciding whether labels should be fixed.
Order the reasoning for deciding whether a noisy development set should be corrected.
When should mislabeled dev-set examples be fixed?
Decide When Incorrect Validation Labels Should Be Fixed
When is it worth fixing mislabeled validation examples?
When is cleaning dev-set labels worth the effort?
Fixing validation labels one by one is always required.