Whether to Use 180,000 Public-Web Photos Alongside 4,000 App Photos
Case context: A retail company has 180,000 photos collected from public websites and 4,000 photos submitted by people using its mobile app. The team can train a very large neural network for a long time on the full set of 184,000 images.
Question: Should the company include the public-web photos, and what conditions make that choice reasonable?
Sample answer: Yes. If the model is very large and the training run is long enough on the combined dataset, then adding the public-web photos is reasonable. Under those conditions, the difference in dataset size does not by itself prevent the system from learning from both sources.
Key points:
- Include the public-web photos.
- Use a very large neural network.
- Train long enough on all 184,000 images.
- The 45:1 size imbalance does not, on its own, rule out this choice.
- The aim is to improve performance on both data sources.
Rubric: Full credit requires a clear decision to include the public-web photos, both enabling conditions of model size and long training, recognition that learning from both sources is the goal, and correct handling of the 45:1 ratio as compatible with the recommendation.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Shared Visual Structure Makes Extra Source Data Helpful
Source-Specific Features Can Consume Model Capacity
When is it reasonable to mix a large set of public web photos into a product-image training set?
A very large network trained long enough can, in principle, learn from two different image collections without an unavoidable tradeoff.
Complete the capacity requirement before adding more training data
Match each training-scenario element with its role in the learning argument.
Order the reasoning steps for deciding whether to add public web photos to training.
Why a larger model can learn from two image sources
Whether to Use 180,000 Public-Web Photos Alongside 4,000 App Photos
When is it reasonable to mix outside web images with app-captured images?
What does the 40:1 dataset ratio suggest in this example?
Combining a second image source always improves model performance.