Why should training results be checked before expecting strong dev/test results?
Question: Answer in one to three sentences using the source's relationship between seen and unseen examples.
Sample answer: Training results show how the algorithm performs on examples it has seen, and dev/test performance is usually worse. Therefore, the algorithm must first perform well on the training set before strong results on unseen dev/test examples can be expected.
Key points:
- Training examples are seen examples.
- Dev/test performance is usually worse.
- Good training performance comes first.
Rubric: The answer should mention seen training examples, the usual disadvantage of dev/test performance, and the need for good training performance first.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What must occur before strong dev/test performance can reasonably be expected?
Dev/test performance is usually worse than training-set performance.
An algorithm must perform well on the _____ set before strong dev/test performance can be expected.
Match each performance concept to its source-based meaning.
Order the reasoning used to evaluate a training-versus-dev/test performance claim.
Explain why training-set performance sets a prerequisite for dev/test performance.
Diagnose a report claiming 85% training accuracy and 95% dev/test accuracy.
Why should training results be checked before expecting strong dev/test results?
Which reported result conflicts with the source's training-first principle?
An algorithm performing poorly on training data can still be expected to perform well on dev/test data.