Why must a test set be big enough?
Question: Answer in one to three sentences using the stated purpose of test-set sizing.
Sample answer: A test set must be big enough so that it gives a confident estimate of the system's final performance.
Key points:
- Confident estimate
- Final performance of the system
Rubric: Full credit requires both confidence in the estimate and final system performance to be mentioned.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What should determine whether a test set is large enough?
A test set is adequately sized when it supports a confident estimate of final system performance.
Complete the principle: The test set should support a _____ estimate of final performance.
Match each part of the test-set sizing principle with its role.
Order the reasoning used to judge whether a test set is sufficiently large.
Explain how confidence in final-performance estimation defines a sufficiently large test set.
Diagnose whether a team's uncertain final-performance estimate signals a test-set sizing problem.
Why must a test set be big enough?
Which team statement best applies the test-set sizing principle?
Test-set size should be judged independently of confidence in the final-performance estimate.