Overfitting to a Few Synthetic Car Designs
A computer vision system trained on synthetic car images from a video game will probably not work well even if the images look realistic. If 100,000 training examples all come from about 20 car designs, the system will overfit to those car designs and fail to generalize well to dev/test sets that include other car designs.
0
1
References
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Overfitting to Reused Synthetic Car Noise
Overfitting to a Few Synthetic Car Designs
Why is it risky if a learning algorithm can distinguish synthesized examples from real ones?
True or False: Using only 1 hour of car noise to synthesize all noisy audio examples is a good practice.
When synthesizing data, put thought into whether you are creating a truly _____ set of examples.
Match each synthesis scenario to whether it produces representative data.
Order the reasoning steps for checking if synthesized data is representative.
Explain why representativeness matters when synthesizing training data.
Diagnose a car detection team's audio synthesis strategy.
What test can indicate whether synthesized data is not representative?
Which synthesis approach best avoids the representativeness problem described in the source?
True or False: Synthesizing car images from only 20 car designs can make synthesized data non-representative.
Overfitting to Reused Synthetic Car Noise
Overfitting to a Few Synthetic Car Designs
Learn After
Why does a car-recognition system trained on 100,000 synthetic images from only ~20 car designs fail to generalize?
True or False: Realistic-looking synthetic images guarantee good generalization if enough images are generated.
If 100,000 training images all come from ~20 car designs, the system will _____ to those specific designs.
Match each dataset property in the synthetic car example to its description.
Order the reasoning steps explaining why the synthetic car training data leads to overfitting.
Explain why example count alone does not prevent overfitting in the synthetic car dataset.
Diagnose why a car-recognition model performs poorly despite strong training accuracy.
In one to three sentences, what does the ~20 car designs represent relative to the real-world distribution of cars?
Which change would most directly reduce the overfitting risk described in the synthetic car example?
True or False: This overfitting risk applies only to car recognition and not to other synthetic data generation approaches.