Learn Before
When is label correction a poor choice?
Question: Answer in one to three sentences by naming the two situations in which correcting labels is not a good idea.
Sample answer: Label correction is a poor choice if the corrected labels will be used in a scholarly publication or if you need an unbiased estimate of performance on the test set.
Key points:
- Use in a scholarly publication
- Need for an unbiased test-set performance estimate
Rubric: Award full credit for identifying both the publication-use case and the need for an unbiased test-set estimate.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
When is it acceptable to clean up noisy labels even if the labels are not perfectly objective?
True or False: Correcting labels before reporting results in a research paper can create problematic label-correction bias.
Label-correction bias may be acceptable when the goal is simply to build a _____ or service.
Match each scenario to whether label correction is acceptable.
Order the steps for deciding whether label-based correction is acceptable
Why Label Cleanup Can Be Acceptable in Some Settings
Decide when relabeling bias is acceptable in two planned uses of a result.
When is label correction a poor choice?
A project needs an unbiased held-out accuracy estimate. How should it view relabeling errors in that set?
A small product team and a publishable research study should always handle label fixes in the same way.