A Large Training-Dev Gap Indicates Data Mismatch
A classifier has nearly the same error on the training set and a training-dev set, and both errors are close to expert-level performance. However, its error on the ordinary dev set is much worse. The main problem is data ____ .
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
High Bias and Data Mismatch with a Small Training Gap
How can a single learning algorithm show avoidable bias, variance, and data mismatch at the same time?
True or False: A learning system can have both high avoidable bias and a data mismatch problem even if its variance is not high.
An algorithm can have any _____ of high avoidable bias, high variance, and data mismatch.
How can underfitting, overfitting, and distribution shift appear in the same model?
High Variance and Domain Mismatch Can Occur Together Without High Bias
A model may contain any _____ of three common error sources.
Match each error source to the comparison that best exposes it.
Order the checks used to diagnose bias, variance, and distribution shift.
A model has about the same error as expert performance on the training set, its training-dev error is nearly identical to its training error, and its dev-set error is much worse. What issue is most likely present?
If a classifier has high avoidable bias, it must also have high variance and a data mismatch problem.
A Large Training-Dev Gap Indicates Data Mismatch
Connect each error pattern to the combination of issues it signals.
Plan the Next Fix When Three Error Sources Are Present
Why Multiple Error Sources Can Appear at the Same Time
Diagnosing Multiple Error Sources in a Voice Transcription Model
Can Different Error Problems Appear Separately?