Representative Synthesized Training Examples
When synthesizing data, one should consider whether the synthesized examples are representative. Synthesized data should avoid properties that make it possible for a learning algorithm to distinguish synthesized from non-synthesized examples, such as all synthesized car data coming from 20 car designs or all synthesized audio coming from only 1 hour of car noise.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
No Guaranteed Path for Addressing Data Mismatch
Artificial Data Synthesis for Dev-Set Matching
Representative Synthesized Training Examples
When a model performs well on training data but poorly on the dev set due to distribution differences, what is one recommended strategy?
A data mismatch problem exists when a model performs well on its training set but poorly on a dev set drawn from a different distribution.
When most dev set audio clips were recorded in a _____, one solution is to acquire more training data from that same setting.
Match each concept related to data mismatch to its correct description from ML Yearning.
Order the steps for diagnosing and addressing a data mismatch problem in a speech recognition system.
In ML Yearning's speech recognition example, what is the primary cause of the model's poor performance on the dev set?
According to ML Yearning, acquiring training data that matches the dev set distribution is guaranteed to resolve a data mismatch problem.
To address a data mismatch problem, one recommended option is to find more training data that better _____ the dev-set examples the algorithm has trouble with.
Match each component of the speech recognition scenario to its role in ML Yearning's data mismatch framework.
Order the reasoning steps a practitioner should follow when deciding to seek targeted training data to address a data mismatch.
How does acquiring targeted training data address a data mismatch problem?
Diagnose and resolve the speech recognition mismatch
What training data strategy helps resolve data mismatch?
Learn After
Overfitting to Reused Synthetic Car Noise
Overfitting to a Few Synthetic Car Designs
Why is it risky if a learning algorithm can distinguish synthesized examples from real ones?
True or False: Using only 1 hour of car noise to synthesize all noisy audio examples is a good practice.
When synthesizing data, put thought into whether you are creating a truly _____ set of examples.
Match each synthesis scenario to whether it produces representative data.
Order the reasoning steps for checking if synthesized data is representative.
Explain why representativeness matters when synthesizing training data.
Diagnose a car detection team's audio synthesis strategy.
What test can indicate whether synthesized data is not representative?
Which synthesis approach best avoids the representativeness problem described in the source?
True or False: Synthesizing car images from only 20 car designs can make synthesized data non-representative.