Learn Before
How should earlier validation-set sizing guidance inform a training-dev set?
Question: In a concise analytical response, explain what you can and cannot conclude about choosing the size of a training-dev set from earlier validation-set advice.
Sample answer: You can usually carry over most of the earlier validation-set sizing advice when deciding the training-dev set size. But the guidance does not say every rule transfers unchanged, since it says only most of them do. So the training-dev set should generally be sized with the same broad principles, without assuming perfect one-to-one equivalence.
Key points:
- Earlier sizing advice for the validation set is the relevant starting point.
- Most of that advice also applies to the training-dev set.
- The guidance stops short of saying all rules apply.
- No new sizing formula is provided here.
Rubric: A strong response identifies the earlier validation-set guidance, explains that it mostly carries over to the training-dev set, and distinguishes partial from complete applicability without inventing extra rules.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
How should guidance for a general dev set be used when selecting a training dev set?
Rules for choosing a development set size usually also guide the training-dev set.
Most advice for selecting a dev set size also applies to the _____.
Match each dataset to its sizing role.
How to choose a training dev set size
How should earlier validation-set sizing guidance inform a training-dev set?
Choose how to size a new model-tuning set.
Which sizing principles should be reused for a training dev set?
What does the word βmostβ imply in applying earlier sizing guidance to a training dev set?
Reducing the validation set size is the standard way to fix validation-set overfitting.