Explain why test-set size should be judged by confidence in overall performance.
Question: In a concise analytical response, explain the relationship among test-set size, high confidence, and the system's overall performance.
Sample answer: Test-set size should be evaluated according to whether the set is large enough to give high confidence in the system's overall performance. Thus, size is not treated as an isolated goal; it serves the purpose of supporting a confident overall performance estimate.
Key points:
- The test set must be large enough.
- The desired result is high confidence.
- The confidence concerns overall system performance.
- Test-set size serves the performance-estimation goal.
Rubric: A strong response accurately connects test-set size to high confidence and applies that confidence to overall system performance without introducing unsupported criteria.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
What should determine whether a test set is large enough? for Test Set Should Support High-Confidence Performance Estimates
A test set is adequately sized when it supports high confidence in overall system performance.
The test set should give high confidence in the system's _____ performance.
Match each test-set concept to its source-grounded meaning.
Order the reasoning used to judge whether a test set is sufficiently large. for Test Set Should Support High-Confidence Performance Estimates
Explain why test-set size should be judged by confidence in overall performance.
Decide whether a team has used the correct criterion for test-set size.
What is the stated purpose of making the test set large enough?
Which test-set sizing justification best follows the source?
Test-set size should be considered independently of confidence in overall system performance.