Learn Before
When to Add a Mislabeled Category to Error Analysis
Question: In an error-analysis table, what should you do if you think annotation mistakes may be common, and what six column headings should the table contain?
Sample answer: If the amount of bad labeling appears large enough to matter, add a Mislabeled column so you can record how many examples have incorrect labels. The table should include these six headings: Image, Dog, Great cat, Blurry, Mislabeled, and Comments.
Key points:
- Add a Mislabeled category when you suspect label errors are frequent enough to affect the analysis.
- Use it to track the share of examples with incorrect annotations.
- The six headings are Image, Dog, Great cat, Blurry, Mislabeled, and Comments.
Rubric: A complete answer must state the trigger for adding the category, explain that its role is to measure the fraction of mislabeled examples, and list all six table columns exactly as given: Image, Dog, Great cat, Blurry, Mislabeled, and Comments.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
When should a review log include a separate bucket for likely data issues?
When to mark an example as mislabeled
When you suspect many development examples may have the wrong label, what kind of spreadsheet column should you add to flag them?
When should you add a label-quality column to your error log?
A mislabeled entry in an error log marks cases where the reference label is wrong.
Add a mislabeled category to the error-analysis sheet when the _____ of incorrect labels appears to be substantial.
Match each spreadsheet column name to the kind of error information it records.
Order the Steps for Adding a Wrong-Label Column to an Error Review Spreadsheet
Which column is not part of the digit review log?
A mislabeled column belongs in every error-analysis spreadsheet by default.
Audit Sheet Column for Incorrect Labels
Match each description to the correct column in the review log.
Order the reasoning steps that lead a practitioner to add a 'Label error' column rather than ignoring suspected bad labels.
When to Add a Mislabeled Category to Error Analysis
Case study: Updating an error analysis spreadsheet when some labels may be wrong.
When to Add a Mislabeled Column