Case Study

If the validation curve reaches the target after the data set doubles, what should be concluded?

Case context: A model team draws a target validation-error level on a learning curve. By extending the observed trend beyond the current sample count, the curve appears to meet that target at roughly two times the present data size.

Question: What does this suggest about the value of collecting additional examples, and how definite should that judgment be?

Sample answer: This suggests that increasing the data set to about twice its current size may be enough to get to the target. The team should treat that as a rough forecast, not as a promise, because it comes from extending the curve rather than from a direct test.

Key points:

  • The target level is the benchmark being compared against.
  • Extending the learning trend points to improvement from more examples.
  • A doubling of the data appears likely to help enough.
  • A projected trend is only an estimate, so it is not certain.

Rubric: The response should link the projected meeting point with the benchmark to a plausible payoff from doubling the data and should clearly state that the conclusion is uncertain rather than guaranteed.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI