When is it acceptable to clean up noisy labels even if the labels are not perfectly objective?

True or False: Correcting labels before reporting results in a research paper can create problematic label-correction bias.

Label-correction bias may be acceptable when the goal is simply to build a _____ or service.

Match each scenario to whether label correction is acceptable.

Order the steps for deciding whether label-based correction is acceptable

Why Label Cleanup Can Be Acceptable in Some Settings

Decide when relabeling bias is acceptable in two planned uses of a result.

When is label correction a poor choice?

A project needs an unbiased held-out accuracy estimate. How should it view relabeling errors in that set?

A small product team and a publishable research study should always handle label fixes in the same way.