Three functions of a very small validation set
Question: If a project has only a tiny validation set and uses it as the main set for frequent review, what three tasks can that set still support? Answer in one to three sentences.
Sample answer: It can be used for manual review of errors, comparing candidate models, and adjusting hyperparameters.
Key points:
- Manual review of errors
- Comparing candidate models
- Adjusting hyperparameters
Rubric: The answer should name all three tasks. Give partial credit for correctly naming one or two of them.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What is the best use of a development set that is too small to split?
A very small development set can be kept as one set instead of being split.
If the development set cannot be divided, use the _____ development set as the eyeball set.
Match each item to its role in a small validation-set workflow.
Put the steps for deciding what to do with a very small development set in order
What to do with a too-small development set
How to handle a validation set that is too small to split
Best use of a dev set that is too small to split
If the full development set is used as an eyeball set, it cannot be used for hyperparameter selection.
Related
What is the best use of a development set that is too small to split?
A very small development set can be kept as one set instead of being split.
If the development set cannot be divided, use the _____ development set as the eyeball set.
Match each item to its role in a small validation-set workflow.
Put the steps for deciding what to do with a very small development set in order
What to do with a too-small development set
How to handle a validation set that is too small to split
Best use of a dev set that is too small to split
If the full development set is used as an eyeball set, it cannot be used for hyperparameter selection.