Short Answer

Identify the primary system metric to improve before expecting dev/test set gains.

Question: According to Andrew Ng's Machine Learning Yearning, if your training set error rate is 15% and your target is 5%, what performance must you improve first before you can expect dev or test performance to improve?

Sample answer: You must first improve the algorithm's performance on the training set.

Key points:

  • Improve performance on the training set first.
  • Do not expect dev/test performance to improve while training error remains high.

Rubric: The answer must identify the training set performance (or training error/training set accuracy) as the first metric that needs to be improved.

0

1

Updated 2026-05-26

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Related