Learn Before
What does “worse” mean in an informal variance comparison?
Question: In an informal comparison of training and validation or test performance, what does it mean when one side is described as worse, and which result is used as the baseline?
Sample answer: It means the validation or test performance is poorer than the training performance. Training performance is the reference point used to judge how much the model has degraded.
Key points:
- The worse result is usually on the validation or test set.
- Training performance is the comparison baseline.
Rubric: Credit answers that identify validation or test as worse than training and state that training is the reference used for the comparison.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What does variance mean in this informal comparison?
A larger performance gap between training data and validation data is an informal sign of variance.
Variance compares test performance to the ____ performance.
Match each term to its role in the informal variance idea.
Order the steps for judging whether a model has high variance
Why does the informal idea of variance require a comparison between training and held-out results?
Interpret a gap between training and validation performance.
What does “worse” mean in an informal variance comparison?
What information is needed to judge variance informally?
An informal variance score is defined as training-set error minus test-set error.