Learn Before
A model with enough capacity can often learn patterns from both a main dataset and a smaller auxiliary dataset without necessarily running out of room.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
When a small model is trained with a tiny target dataset and a much larger auxiliary dataset, what should the team focus on first?
A model with enough capacity can often learn patterns from both a main dataset and a smaller auxiliary dataset without necessarily running out of room.
With limited compute, assign extra context a much _____ weight.
Match Each Model Setting to Its Likely Effect
Order the reasoning for selecting a weighting strategy for extra training data.
How model size affects the importance of training-set alignment
How should a small vision team use a much larger auxiliary image collection?
Why does reducing the influence of extra training data ease model-size demands?
Which situation most strongly suggests lowering the weight of a large auxiliary data source?
Should a small team always ignore extra training data that comes from a different distribution?