How much of the real-world distribution do a handful of synthetic bicycle designs cover?
Question: In one to three sentences, explain what the roughly 18 bicycle models produced by a simulator represent compared with the full distribution of bicycles that a dev/test set would need to cover.
Sample answer: Those 18 models cover only a tiny slice of the bicycles that appear in the real world. Even if the simulator output looks believable, it cannot capture the wide range of frame styles, sizes, accessories, and wear conditions that a dev/test set should reflect.
Key points:
- 18 models is only a small subset of the real distribution
- Realistic appearance does not imply full diversity
- Dev/test data should reflect the broader real-world distribution
Rubric: Full credit: says the synthetic designs are a tiny subset of the true distribution and notes the mismatch with dev/test coverage. Partial credit: mentions limited variety without linking it to dev/test data.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Why might a detector trained on 120,000 synthetic storefront images built from only 25 shop layouts fail on real streets?
True or False: If a generator makes highly realistic-looking synthetic storefront photos, a classifier will generalize well once enough of those images are produced.
If 80,000 training photos all show only a dozen apartment floor plans, the model may _____.
Match each property of a synthetic road-sign dataset to its description.
Order the reasoning steps showing why a large synthetic robot dataset still causes overfitting.
Why a huge synthetic dataset can still be too narrow
Why a Large Synthetic Bicycle Dataset Failed on Real-World Photos
How much of the real-world distribution do a handful of synthetic bicycle designs cover?
Which change would most directly lower overfitting risk in the simulated bridge-inspection dataset?
True or False: This synthetic-data overfitting risk is limited to one category of object and does not apply elsewhere.