Case Study

Using validation loss to stop training early

Case context: You are fitting a forecasting network on historical sales records. The training loss keeps getting smaller, but after several passes through the data, the validation loss starts to climb. To curb overfitting, you decide to end the optimization run once the validation metric stops improving.

Question: What method are you using, which optimization procedure is being cut short, and what bias–variance effect should you expect?

Sample answer: This is early stopping. You interrupt gradient descent before it fully converges by watching the validation loss. The usual consequence is lower variance and higher bias.

Key points:

  • Method: early stopping
  • Procedure cut short: gradient descent
  • Effect on variance: it decreases
  • Effect on bias: it increases

Rubric: The learner must identify early stopping, name gradient descent as the procedure being stopped, and state that variance decreases while bias increases.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Data Science

D2L

Dive into Deep Learning @ D2L

Machine Learning

Deep Learning

Supervised Learning

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI