Learn Before
Essay

Why does the informal idea of variance require a comparison between training and held-out results?

Question: In a concise analytical response, explain why training performance by itself or held-out performance by itself does not fully capture the informal meaning of variance.

Sample answer: Informal variance refers to how much worse a model performs on a validation or test set than it does on the training set. That means the concept is based on a comparison between two performance levels. If you look at only one result, you do not see the performance gap that the term is meant to describe.

Key points:

  • Training performance provides the baseline.
  • Validation or test performance is compared against that baseline.
  • Variance is the amount of degradation from training to held-out data.
  • One performance number alone does not show the gap.

Rubric: A strong response identifies both parts of the comparison, explains that variance is the difference between them, and states why either result alone is incomplete.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI