Learn Before
Why should the test set be made large enough?
Question: Answer in one to three sentences using only the underlying principle.
Sample answer: A larger test set makes the evaluation less noisy, so the measured score is a more trustworthy estimate of how the model will do on future data.
Key points:
- Less evaluation noise
- More trustworthy estimate
- Future data performance
Rubric: Full credit requires mention of both reduced uncertainty in evaluation and a reliable estimate of future performance; answers that only say the set should be big are incomplete.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
What is the key requirement for choosing a test set size?
A sufficiently large test set makes the final performance estimate more reliable.
A test set should support a high-confidence estimate of the model's _____ performance.
Match each test-set concept to the meaning it carries in this context.
Order the reasoning used to decide whether a test sample is large enough to support a dependable estimate.
Choosing test-set size for a reliable estimate
Decide whether a team has used the right standard for test-set size.
Why should the test set be made large enough?
Why test-set size matters
Increasing the test-set size does not change how confident we can be in the estimated overall performance.