Sample the Worst Training Cases to Find Error Patterns
When a model performs poorly on the training set, a practical first step is to review about 100 training examples where it makes the largest mistakes. Group those cases into a few error categories to see which kinds of failures are most common.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Sample the Worst Training Cases to Find Error Patterns
When is it useful to analyze errors on the training set?
A model with high bias is usually underfitting.
When bias is high, begin error analysis on the _____ set.
Match each diagnostic idea with its meaning in training analysis.
Order the steps for deciding whether to inspect training-set mistakes.
Why Train-Set Error Analysis Matters Under Underfitting
Next Step After a Model Still Fits the Training Set Poorly
Identifying High Bias Through Training Error Review
How does training-set error analysis fit into a high-bias debugging plan?
Training-set mistake analysis can use the same kind of procedure as dev-set mistake analysis.
Learn After
Common Error Labels for Volunteer Audio Clips
What should you do first when a model is making many mistakes on the training set?
True or False: A useful way to inspect training mistakes is to group them into categories and count how often each type appears, similar to dev-set error analysis.
How many bad training examples should you inspect first?
Match Each Training-Review Idea to Its Description
Put the training-set review process in the correct order.
Why inspecting a small set of bad training cases can reveal training-set problems
Diagnosing Poor Training Performance in a Speech Model
What should you do when training performance is poor?
What is the main purpose of reviewing training examples that the model handles poorly?
True or False: Diagnosing model failures requires checking every training example in the dataset.