Learn Before
When is label correction a poor choice?
Question: Answer in one to three sentences by naming the two situations in which correcting labels is not a good idea.
Sample answer: Label correction is a poor choice if the corrected labels will be used in a scholarly publication or if you need an unbiased estimate of performance on the test set.
Key points:
- Use in a scholarly publication
- Need for an unbiased test-set performance estimate
Rubric: Award full credit for identifying both the publication-use case and the need for an unbiased test-set estimate.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
When is it acceptable to clean up noisy labels even if the labels are not perfectly objective?
True or False: Correcting labels before reporting results in a research paper can create problematic label-correction bias.
Label-correction bias may be acceptable when the goal is simply to build a _____ or service.
Match each scenario to whether label correction is acceptable.
Order the steps for deciding whether label-based correction is acceptable
Why Label Cleanup Can Be Acceptable in Some Settings
Decide when relabeling bias is acceptable in two planned uses of a result.
A project needs an unbiased held-out accuracy estimate. How should it view relabeling errors in that set?
A small product team and a publishable research study should always handle label fixes in the same way.
Related
When is it acceptable to clean up noisy labels even if the labels are not perfectly objective?
True or False: Correcting labels before reporting results in a research paper can create problematic label-correction bias.
Label-correction bias may be acceptable when the goal is simply to build a _____ or service.
Match each scenario to whether label correction is acceptable.
Order the steps for deciding whether label-based correction is acceptable
Why Label Cleanup Can Be Acceptable in Some Settings
Decide when relabeling bias is acceptable in two planned uses of a result.
A project needs an unbiased held-out accuracy estimate. How should it view relabeling errors in that set?
A small product team and a publishable research study should always handle label fixes in the same way.