Explain why the acceptability of label-correction bias depends on the intended use of the result.
Question: In a concise analytical response, contrast product or application development with academic reporting and completely unbiased test-set accuracy measurement.
Sample answer: Label-correction bias can be acceptable when the only objective is to develop a product or application. It becomes problematic when the result will be used in an academic research paper or when a completely unbiased measure of test-set accuracy is required. Thus, the judgment depends on whether the intended use can tolerate the bias or explicitly demands an unbiased result.
Key points:
- Acceptable for product development only
- Acceptable for application development only
- Problematic for an academic research paper
- Problematic when completely unbiased test-set accuracy is needed
- Intended use determines the judgment
Rubric: A strong response accurately states the acceptable development-only context, identifies both problematic contexts, and explains that intended use determines acceptability.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
In which situation is label-correction bias acceptable?
Label-correction bias is problematic when reporting results in an academic paper.
Label-correction bias is acceptable when the goal is only to develop a _____ or application.
Match each intended use with the correct judgment about label-correction bias.
Order the reasoning process for deciding whether label-correction bias is acceptable.
Explain why the acceptability of label-correction bias depends on the intended use of the result.
Decide whether a team may accept label-correction bias in two planned uses of its result.
What two needs make label-correction bias problematic?
A team needs completely unbiased test-set accuracy. How should it regard label-correction bias?
A development-only application project and an academic paper should treat label-correction bias identically.