Why the validation-error curve is usually above the training-error curve
Question: In a short explanation, relate a model's typical performance on the data it was fit on to its performance on held-out data, and use that to describe the positions of the two error curves.
Sample answer: A model is usually optimized to perform best on the training data. That usually makes the training error lower than the validation error. Since lower error is drawn lower on the graph, the validation-error curve usually sits above the training-error curve.
Key points:
- The model usually performs better on the training data.
- Better performance means lower error.
- Lower error places the training curve below the validation curve.
Rubric: A strong response should mention the typical performance gap, connect that gap to lower training error, and explain why the validation curve appears higher.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
How do training error and dev error typically compare for a fitted model?
Validation error is usually higher than training error.
A model often makes fewer errors on the _____ set.
Match each plot element with its usual meaning.
Put the usual training-versus-validation error reasoning in order.
Why the validation-error curve is usually above the training-error curve
Read a chart where the validation-error line sits above the training-error line.
What does a validation-error curve above the training-error curve mean?
In a typical learning curve plot, how do training error and dev error usually compare?
Typical Relationship Between Training and Development Error