Why is the 100-example dev set inadequate in the source example?
Question: Answer in one to three sentences using the classifier accuracies and the stated limitation.
Sample answer: The dev set is inadequate because 100 examples cannot detect the 0.1 percentage-point difference between 90.0% and 90.1% accuracy. The author considers a 100-example dev set small compared with other machine learning problems observed.
Key points:
- 100-example dev set
- 90.0% versus 90.1% accuracy
- The difference cannot be detected
Rubric: The answer should mention the 100-example size, the 0.1 percentage-point difference or both accuracies, and the inability to detect that difference.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
What can a 100-example dev set reveal about 90.0% versus 90.1% accuracy?
Can 100 dev examples detect a 0.1 percentage-point accuracy difference?
A 100-example dev set cannot detect a _____ percentage-point accuracy difference.
Match each element of the example to its source-based description.
Order the reasoning used to assess the 100-example dev set.
Explain why the example illustrates a limitation of a small dev set.
Diagnose whether a small dev set can distinguish two nearly equal classifiers.
Why is the 100-example dev set inadequate in the source example?
Which observation best supports calling the dev set too small for this comparison?
Does the author characterize 100 dev examples as small?