How many validation mistakes should be checked to find the main error patterns?
Question: Roughly how many validation errors should you inspect by hand to get a useful picture of the main types of mistakes?
Sample answer: You should inspect about 50 errors.
Key points:
- About 50 mistakes is a good target.
- This amount is usually enough to reveal the main error patterns.
Rubric: The answer must clearly state that approximately 50 mistakes should be reviewed.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
What does inspecting roughly 50 validation mistakes usually reveal?
A small sample of dev-set errors can reveal the main failure modes.
With about _____ manually reviewed mistakes, you can usually identify the main error patterns.
Match each error-analysis term to its description.
Order the steps for manually reviewing mistakes in a small validation sample.
Why Review a Small Set of Mistakes?
You must examine several hundred validation errors before you can tell what the main failure modes are.
Looking through about 50 manually sampled mistakes usually reveals the main error _____.
Match each manual error-review element to its role in diagnosing recurring mistakes.
Order the steps for deciding whether a manual review of dev-set errors is useful.
Why review about 50 errors in a manual error check?
Choosing a small error review sample.
How many validation mistakes should be checked to find the main error patterns?