Using Error Analysis to Investigate Dataset Mismatch
When a model performs differently on training data and dev data, error analysis is used to compare the two sets and identify the important differences that may be causing the gap.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Using Error Analysis to Investigate Dataset Mismatch
What Should You Do First When Training and Development Data Do Not Match?
True or false: If a model performs well on the training set but poorly on the dev set, a useful next step is to compare how the two datasets differ.
What should you compare when diagnosing a data mismatch?
When a training set and a validation set look different, what should you examine first?
When a model performs differently on two datasets from different populations, a useful first step is to identify which properties of the examples differ between the two sets.
When a train-dev mismatch is suspected, the key diagnostic is to compare which _____ differ across the two datasets.
Match each data-split term to its meaning in diagnosing distribution shift.
Put the steps for identifying a training-development mismatch in order.
Why compare training-set properties with dev-set properties when a model shows a mismatch problem?
True or False: A model that scores well on training data but much worse on dev data is probably underfitting.
A gap between _____ performance and dev-set performance can signal data mismatch.
Match each observation or action to its correct interpretation in a data mismatch diagnosis.
Order the reasoning for diagnosing a training-dev mismatch
How to investigate a dataset mismatch after a dev-set drop
Investigating a gap between training and validation performance in a restaurant review classifier
Comparing dataset characteristics after validation failure
Learn After
Train-Station Audio as a Speech Recognition Data Mismatch Example
What is the main purpose of error analysis when a model works well on suburban data but fails more often on downtown data?
Data Mismatch Is Diagnosed on the Test Set
The goal of error analysis in a data mismatch review is to identify the important _____ between the training data and the dev data.
Match each item to its role in a data mismatch review.
Arrange the steps for diagnosing a mismatch between training performance and dev-set performance.
What most directly causes a data mismatch between training and development performance?
Goal of Error Analysis in a Data-Mismatch Study
In a dataset-mismatch review, compare the training set against the _____ set.
Match each step in a distribution-gap review to its main purpose.
Order the steps for diagnosing a training–validation mismatch using error analysis.
Using error analysis to investigate a train-dev mismatch
Diagnosing a Training–Validation Gap
Purpose of error analysis in a mismatch study