Learn Before
When to Add a Mislabeled Column
Question: When should you add a "Mislabeled" column to an error analysis spreadsheet, and what does it help you measure?
Sample answer: Add the column when you suspect that label errors may account for a meaningful share of the mistakes. The column helps you record the fraction of examples whose labels appear to be wrong.
Key points:
- Add it when you think mislabeled data may be a significant issue.
- Use it to track the fraction of examples with incorrect labels.
Rubric: To receive full credit, the answer must state that the column is added when mislabeled examples may be common, and that it is used to track the share of examples with incorrect labels.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
When should a review log include a separate bucket for likely data issues?
When to mark an example as mislabeled
When you suspect many development examples may have the wrong label, what kind of spreadsheet column should you add to flag them?
When should you add a label-quality column to your error log?
A mislabeled entry in an error log marks cases where the reference label is wrong.
Add a mislabeled category to the error-analysis sheet when the _____ of incorrect labels appears to be substantial.
Match each spreadsheet column name to the kind of error information it records.
Order the Steps for Adding a Wrong-Label Column to an Error Review Spreadsheet
Which column is not part of the digit review log?
A mislabeled column belongs in every error-analysis spreadsheet by default.
Audit Sheet Column for Incorrect Labels
Match each description to the correct column in the review log.
Order the reasoning steps that lead a practitioner to add a 'Label error' column rather than ignoring suspected bad labels.
When to Add a Mislabeled Category to Error Analysis
Case study: Updating an error analysis spreadsheet when some labels may be wrong.
When to Add a Mislabeled Column