Common Dev Set Sizes for Detecting 0.1% Improvements
Dev sets with 1,000 to 10,000 examples are common. With 10,000 examples, there is a good chance of detecting an improvement of 0.1%.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Learn After
How many dev set examples does Andrew Ng recommend to reliably detect a 0.1% accuracy improvement?
True or False: A dev set of 1,000 examples gives you a good chance of detecting a 0.1% accuracy improvement.
Dev sets with _____ to 10,000 examples are described as common in Machine Learning Yearning.
Which range represents the common size for a dev set according to Andrew Ng's Machine Learning Yearning?
True or False: A dev set of 10,000 examples gives you a good chance of detecting an accuracy improvement of 0.1%.
With _____ dev set examples, you have a good chance of detecting an accuracy improvement of 0.1%.
Match each dev set concept to its correct description.
Order the steps for reasoning about whether your dev set is large enough to detect a 0.1% improvement.
What accuracy improvement can you expect to reliably detect with a 10,000-example dev set, per Machine Learning Yearning?
True or False: A dev set of 1,000 examples is too small to fall within the commonly recommended dev set size range.
Dev sets with sizes from _____ to 10,000 examples are considered common in practice.
Match each dev set scenario to its correct outcome or classification.
Order the reasoning steps behind Andrew Ng's recommendation of 10,000 examples for detecting 0.1% improvements.
Explain the relationship between dev set size and the ability to detect minor accuracy improvements, citing common size ranges.
Evaluating a Dev Set Size for Detecting 0.1% Classifier Improvements
Determining the Dev Set Size for 0.1% Performance Changes