Why a larger model can learn from two image sources
Question: In a concise analytical response, explain why adding a much larger web photo collection can be safe under the stated assumptions, even when the web set is far bigger than the app set.
Sample answer: If the network has enough capacity and is trained long enough on the full mixed dataset, it can fit patterns from both app photos and web photos at the same time. In that case, the fact that one source has many more examples does not create a theoretical problem by itself. Under these conditions, the extra web photos can help rather than hurt performance.
Key points:
- The model needs enough capacity to represent both sources.
- Training must continue long enough on the combined data.
- The model can optimize for both app and web images together.
- A large imbalance in sample counts does not by itself break the argument.
- Adding the extra data is expected to improve performance.
Rubric: A strong response mentions both required conditions, explains that the model can learn from both data sources simultaneously, and states that the size imbalance alone does not imply harm.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Shared Visual Structure Makes Extra Source Data Helpful
Source-Specific Features Can Consume Model Capacity
When is it reasonable to mix a large set of public web photos into a product-image training set?
A very large network trained long enough can, in principle, learn from two different image collections without an unavoidable tradeoff.
Complete the capacity requirement before adding more training data
Match each training-scenario element with its role in the learning argument.
Order the reasoning steps for deciding whether to add public web photos to training.
Why a larger model can learn from two image sources
Whether to Use 180,000 Public-Web Photos Alongside 4,000 App Photos
When is it reasonable to mix outside web images with app-captured images?
What does the 40:1 dataset ratio suggest in this example?
Combining a second image source always improves model performance.