How should a resource-limited image team use a dominant internet dataset?
Case context: A team evaluates on mobile app images. It has 5,000 mobile app images and 40 times as many internet images, but it cannot afford a neural network large enough to model both sources equally well.
Question: Diagnose the team's capacity problem and decide how it should weight the internet images according to the source.
Sample answer: The much larger internet dataset may demand far more computation and representation capacity if the model must perform well on both sources. Because the team cannot build a sufficiently large network and its evaluation distribution is mobile app images, it should pay closer attention to matching that target distribution. It can still use the internet images, but should give them a much lower weight as a compromise.
Key points:
- Internet images greatly outnumber target-distribution images.
- Modeling both sources can exceed available computation or capacity.
- The mobile app distribution should receive greater attention because it matches evaluation.
- Internet images should remain in training but receive a much lower weight.
Rubric: The response should identify competition for limited capacity, prioritize the mobile app dev/test distribution, and recommend lower—not zero or higher—weight for the internet images.
0
1
References
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What should a team with limited model capacity prioritize when auxiliary data greatly outnumbers target data?
Does ample model capacity reduce concern about competition between target and auxiliary data?
With constrained computation, give auxiliary images a much _____ weight.
Match each capacity condition or training choice to its implication.
Order the reasoning for choosing an auxiliary-data weighting strategy.
Explain why model capacity changes the importance of training-data matching.
How should a resource-limited image team use a dominant internet dataset?
Why can down-weighting auxiliary data reduce the required network size?
Which observation most strongly signals that auxiliary-image weighting should be reconsidered?
Must a resource-limited team discard all mismatched auxiliary data?