Learn Before
Spotting a New Error Category During Review
Case context: You are analyzing mistakes made by a document OCR system. Your current spreadsheet has four error labels: faint text, tilted page, low resolution, and cropped margins. After reviewing 60 misread pages, you notice that 14 of them are partially covered by a rubber stamp, which does not fit any of the existing labels.
Question: According to good error-review practice, what should you do next in your analysis spreadsheet, and what should you ask about those 14 pages?
Sample answer: I should add a new column for a fresh category such as "Stamped over" or "Text covered by stamp" so that this repeated pattern is tracked separately. While examining those 14 pages, I should also ask whether a person could still have read the text accurately despite the stamp, since that may point to a useful fix.
Key points:
- Add a new error category column to the spreadsheet.
- Base the new label on the repeated pattern found during manual review.
- Ask whether a human could have labeled the page correctly despite the obstruction.
Rubric: The response should clearly say that a new error category should be added to the spreadsheet. It should also state that the reviewer should ask whether or how a human could have read the affected pages correctly.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What often happens when you inspect misclassified cases during error analysis?
You must finish defining every error category before reviewing any mislabeled examples.
After you discover that many mistakes come from night-time, motion-blurred photos, you should add a new _____ to the error analysis spreadsheet.
Match each review step to its main role in uncovering new error categories.
Order the steps for expanding error categories during review of mistakes.
When examining a misclassified satellite photo, which question is most useful for uncovering new error categories and fixes?
Reviewing a sample of mistakes can uncover a recurring error type that was not included in the original error categories.
Finding New Error Categories
Match each term from an error-review framework to its description.
Put the error-analysis steps in order after you notice a new pattern in reviewed examples.
Why Error Categories Should Keep Evolving
Spotting a New Error Category During Review
A Human-Comparison Question for Error Review