Three functions of a very small validation set
Question: If a project has only a tiny validation set and uses it as the main set for frequent review, what three tasks can that set still support? Answer in one to three sentences.
Sample answer: It can be used for manual review of errors, comparing candidate models, and adjusting hyperparameters.
Key points:
- Manual review of errors
- Comparing candidate models
- Adjusting hyperparameters
Rubric: The answer should name all three tasks. Give partial credit for correctly naming one or two of them.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What is the best use of a development set that is too small to split?
A very small development set can be kept as one set instead of being split.
If the development set cannot be divided, use the _____ development set as the eyeball set.
Match each item to its role in a small validation-set workflow.
Put the steps for deciding what to do with a very small development set in order
What to do with a too-small development set
How to handle a validation set that is too small to split
Three functions of a very small validation set
Best use of a dev set that is too small to split
If the full development set is used as an eyeball set, it cannot be used for hyperparameter selection.