Weighing proxy photos when no future-like data exists
Question: A company is building a vision system to inspect warehouse bins, but it cannot collect photos that match the lighting and camera angle it expects in production. It considers starting with product-catalog photos taken in a studio. Explain the tradeoff involved in that choice.
Sample answer: Using catalog photos can be a practical way to begin, because the team can train and test an initial model instead of waiting for perfect data that may never arrive. The downside is that those photos may differ in important ways from the real production images, so a model trained on them may not work well once it is deployed.
Key points:
- Proxy data can help the team make progress when production-like data is unavailable
- Starting with a substitute dataset avoids delaying the project
- The main cost is a higher chance of mismatch between training data and real use conditions
- The central tradeoff is faster development versus weaker generalization
Rubric: Full credit: response explains that proxy photos are useful as a fallback, states that they let the team start working, and clearly identifies the risk that the model may not generalize to production conditions. Partial credit: response covers only one side of the tradeoff. No credit: response omits the mismatch risk or implies the substitute data is equally representative.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
When is it reasonable to use web-scraped images as a fallback training source?
True or False: Training a model using only images from a polished company website guarantees good performance on real-world images.
A model trained only on one narrow data source may not _____ when conditions change.
Match each data situation to its associated risk or outcome.
Order the decision steps for using website photos when future-like data is hard to obtain.
Weighing proxy photos when no future-like data exists
Explain a performance gap between catalog photos and live camera images.
What risk comes from training on web-scraped photos when the deployment data will differ?
What is the best interpretation of using website images as training data?
True or False: Website images should be your first choice for gathering training data.