Learn Before
Why is this called data mismatch?
Question: In one or two sentences, explain why this problem is given the name “data mismatch.”
Sample answer: It is called data mismatch because the data used for training does not closely resemble the data used for development or testing. The two datasets come from different distributions, so the training set is a poor match for the dev/test set.
Key points:
- The training data and dev/test data are not closely aligned.
- The training set is a poor match for the dev/test set.
Rubric: The response must explain that the name comes from the training set being a poor match for the dev/test set data.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Recognizing Distribution Mismatch from Error Measurements
Collect Training Examples That Resemble the Hard Development Cases
Compare training and development data properties after a mismatch is found
What best describes a mismatch between training data and evaluation data?
A data mismatch problem means the model performs poorly on both training-like data and the development/test data.
Data mismatch and distribution fit
Match each data-distribution term with its description.
Put the diagnostic workflow for dataset shift in the correct order.
What most directly causes a mismatch between training data and evaluation data?
A voice-to-text system can perform well on the training set and training-dev set but still do poorly on the dev set if the dev data comes from a different distribution.
Training Distribution and Evaluation Distribution
Match each performance pattern to the most likely diagnosis of the model's problem.
Put the steps in order for diagnosing a distribution mismatch from model performance.
Explain what a performance gap across two data distributions suggests
Explain why a voice-command model looks strong on one split but weak on another.
Why is this called data mismatch?