Learn Before
Why does error analysis often require repeated passes?
Question: In the context of model debugging, explain why error analysis is usually repeated in several rounds. Describe the typical sequence a practitioner follows when grouping misclassified examples.
Sample answer: Error analysis is repeated because the list of categories usually changes as you inspect more examples. A practitioner may start with no formal labels, look at a small set of errors to invent an initial set of categories, and then tag more examples using those categories. While doing that, new patterns often appear, so earlier examples need to be reviewed again with the expanded set of categories.
Key points:
- Categories may begin as an empty list.
- Early examples help generate the first categories.
- New patterns can appear during manual review.
- Earlier examples should be reconsidered after categories change.
Rubric: Full credit for explaining that error analysis starts without fixed categories, uses initial examples to create categories, discovers additional categories during review, and requires revisiting earlier examples after updates.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What best describes how error analysis should be carried out on a machine learning model?
True or False: You must decide every error label in advance before examining model mistakes.
Grouping mistakes can reveal patterns
Match each stage of an iterative mistake-review cycle to its description.
Arrange the stages of one error-analysis cycle in the correct order.
You find a new mistake pattern while reviewing model outputs for the first time. What is the best next step?
True or False: If error analysis uncovers a new failure type, earlier examples may need to be reviewed again under that new category.
After a second pass reveals new mistake patterns, inspect the same examples using the _____ categories.
Match each property of error review to the label that best describes it.
Arrange the steps that show why error analysis works best as a repeating process.
Why does error analysis often require repeated passes?
Adding a New Error Category During Review
Beginning error review without a checklist