Learn Before
Choose how to size a new model-tuning set.
Case context: A team building a medical billing classifier has reviewed the sizing advice for earlier evaluation splits in Chapters 5–7. The team now needs to decide how large to make a new tuning set for this project.
Question: What should the team conclude about using the earlier sizing advice?
Sample answer: The team should apply most of the earlier split-sizing advice to the new tuning set, but it should not assume that every rule transfers without change. The guidance supports most of the recommendations, so that limitation should be kept in mind.
Key points:
- Review the earlier split-sizing guidance from Chapters 5–7.
- Reuse most of those ideas for the new tuning set.
- Do not invent a universal rule that goes beyond the guidance.
- Preserve the qualification that most, not all, of the guidance applies.
Rubric: Full credit requires saying that most earlier sizing guidance should be used, identifying the new tuning set as the decision target, and avoiding the claim that every guideline transfers.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
How should guidance for a general dev set be used when selecting a training dev set?
Rules for choosing a development set size usually also guide the training-dev set.
Most advice for selecting a dev set size also applies to the _____.
Match each dataset to its sizing role.
How to choose a training dev set size
How should earlier validation-set sizing guidance inform a training-dev set?
Choose how to size a new model-tuning set.
Which sizing principles should be reused for a training dev set?
What does the word “most” imply in applying earlier sizing guidance to a training dev set?
Reducing the validation set size is the standard way to fix validation-set overfitting.