Learn Before
Trace a two-stage bird classification error
Case context: A drone-photo app first locates a bird in an image and crops that region. A second model assigns the bird species. For one test photo, the system predicts "not snowy owl" (y=0), but the correct label is y=1. The team wants to know whether the main weakness is the bird-locating stage or the species classifier.
Question: Explain how to apply error analysis by parts to this example so the team can identify which stage caused the mistake, and say how the result should guide later work.
Sample answer: Inspect the failing example stage by stage. First, check whether the bird locator found the bird and produced a usable crop. Next, check whether the species model received that crop and still assigned the wrong label. Use those checks to decide whether the failure came from the first stage, the second stage, or both. Then repeat the same review on a larger set of mistaken cases, count which stage is most often at fault, and focus improvement effort on that stage.
Key points:
- Check the bird-locating stage on the specific failed example
- Check the species-classification stage on the specific failed example
- Assign the error to the stage or stages that actually failed
- Review many wrong predictions to see which stage causes most of them
- Direct the next round of improvement toward the most common source of error
Rubric: Full credit explains checking both stages for the single error, assigning responsibility to one or both stages, and using a wider sample of errors to decide where to concentrate future work.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Blame the Region Selector When the Crop Is Wrong
Correct Error Attribution After a Valid Detection Box
What does error analysis by parts help you determine in a two-stage wildlife camera pipeline?
Can a package-screening pipeline be split into two stages?
Error Analysis by _____
Match each component to its job in a bird photo classification pipeline.
Order the steps for analyzing a two-stage text-classification mistake by parts.
Find the Weak Link in a Two-Stage Pipeline
Trace a two-stage bird classification error
Two-stage animal ID pipeline
When can one mistaken prediction be blamed on both stages of a pipeline?
True or False: To analyze an error by component, you usually inspect what each stage of the pipeline did on a failed example.