When are uneven training-set sizes useful?
Question: Under what condition is it worth choosing training-set sizes that are spaced unevenly instead of evenly?
Sample answer: This is useful when training every additional model for a standard evenly spaced learning curve would take a lot of compute time or money. Using fewer, strategically chosen sizes can reduce the cost of the experiment.
Key points:
- The method is chosen when training cost is high.
- It helps avoid spending too much compute on many extra models.
Rubric: The answer must state that uneven spacing is relevant when the cost of training the extra models is significant.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Why sample training set sizes at uneven intervals?
Smaller Training Sets Usually Train Faster
Reducing Cost with Nonlinear Data Sizes
Choosing Dataset Sizes for Learning Curves
Choosing Spacing for Learning-Curve Experiments
Why Uneven Training Sizes Save Time
Selecting Sample Sizes for an Efficient Learning Curve
When are uneven training-set sizes useful?
Why Use Uneven Training-Set Sizes for a Learning Curve?
You should always use evenly spaced training-set sizes, even when training extra models is expensive.