Human Benchmark in Error Analysis
Question: When manually looking at examples misclassified by an algorithm, what specific question should you ask yourself to help inspire new error categories and solutions?
Sample answer: You should ask how or whether a human could have labeled the picture correctly.
Key points:
- Ask if a human could have labeled the picture correctly.
- Ask how a human could have labeled the picture correctly.
Rubric: The answer must identify the question of whether or how a human could correctly label the misclassified example.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What commonly happens when you manually examine misclassified examples during error analysis?
Error categories must be fully finalized before you begin examining any misclassified examples.
After noticing many misclassified examples involve Instagram-filtered pictures, you should add a new _____ to the error analysis spreadsheet.
Match each error analysis action to its primary purpose in discovering new error categories.
Order the steps of Ng's iterative error category discovery process during error analysis.
Which question should you ask when reviewing a misclassified image to inspire new error categories and solutions?
The Instagram error category illustrates how manual review can reveal categories absent from the original error analysis framework.
Manually looking at examples that the algorithm _____ and asking whether a human could label them correctly often inspires new error categories.
Match each term from Ng's error analysis framework to its correct description.
Order the reasoning steps a practitioner follows when a new error pattern is spotted during manual example review.
Dynamic Error Analysis Frameworks
Uncovering Hidden Error Patterns
Human Benchmark in Error Analysis