Short Answer

Determining the Dev Set Size for 0.1% Performance Changes

Question: According to Andrew Ng's guidelines, if your machine learning team wants a good chance of detecting a model improvement of 0.1%, what dev set size should you use?

Sample answer: You should use a dev set containing 10,000 examples to have a good chance of detecting an improvement of 0.1%.

Key points:

  • A dev set size of 10,000 examples is recommended.
  • Using 10,000 examples gives a good chance of detecting a 0.1% improvement.

Rubric: The student's answer must specify that a dev set size of 10,000 examples is necessary to have a good chance of detecting a 0.1% improvement.

0

1

Updated 2026-05-27

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Machine Learning Strategy

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Yearning @ DeepLearning.AI

Related