Uncovering Hidden Error Patterns
Case context: You have defined three initial error categories for a bird classification algorithm: 'Lighting issues', 'Small subject', and 'Blurry'. After categorizing 50 misclassified images, you notice that 15 of them involve birds partially hidden behind leaves or branches, which doesn't perfectly fit the initial categories.
Question: Based on Ng's recommendations for reviewing examples, what should your next immediate step be to improve your error analysis process, and what question should you ask yourself about these 15 images?
Sample answer: I should add a new category column to my spreadsheet, such as 'Occluded' or 'Hidden by foliage', to capture this specific pattern. While reviewing these 15 images, I should also ask myself how or whether a human could have correctly labeled the bird despite the obstruction, in order to inspire a potential solution.
Key points:
- Add a new error category column (e.g., occlusion) to the spreadsheet.
- Formulate the new category based on the observed pattern during manual review.
- Ask how or whether a human could correctly label the misclassified image.
Rubric: The response should explicitly state adding a new error category to the spreadsheet. It should also state asking if or how a human could label the images correctly.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What commonly happens when you manually examine misclassified examples during error analysis?
Error categories must be fully finalized before you begin examining any misclassified examples.
After noticing many misclassified examples involve Instagram-filtered pictures, you should add a new _____ to the error analysis spreadsheet.
Match each error analysis action to its primary purpose in discovering new error categories.
Order the steps of Ng's iterative error category discovery process during error analysis.
Which question should you ask when reviewing a misclassified image to inspire new error categories and solutions?
The Instagram error category illustrates how manual review can reveal categories absent from the original error analysis framework.
Manually looking at examples that the algorithm _____ and asking whether a human could label them correctly often inspires new error categories.
Match each term from Ng's error analysis framework to its correct description.
Order the reasoning steps a practitioner follows when a new error pattern is spotted during manual example review.
Dynamic Error Analysis Frameworks
Uncovering Hidden Error Patterns
Human Benchmark in Error Analysis