How does training error help assess the value of more data?
Question: Write a brief analytical response explaining why the dev-error curve by itself is not enough when judging whether additional data will help, and how the training-error curve contributes.
Sample answer: The dev-error curve alone can be hard to extend into the future, so it may not tell you reliably what will happen if the training set becomes larger. Adding the training-error curve gives a second perspective that helps estimate how performance might change as more data is collected. For that reason, training error is best used alongside dev error when evaluating the benefit of more data.
Key points:
- The dev-error curve by itself is difficult to extend forward.
- The question is what may happen to dev error after adding more data.
- Training error provides a second curve.
- The second curve helps estimate the effect of more data.
Rubric: A strong response explains the difficulty of extending the dev-error curve, connects the issue to predicting dev performance with more data, and states that the training-error curve is an additional signal for estimating the effect of extra data.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
More Data Often Raises Training Error
Training Set Error Is Usually Lower Than Dev Set Error
Why plot training error when judging whether more data might improve a model?
A development-error curve computed by itself can be hard to project to much larger training sets.
The extra plot used to judge whether more data will help is _____.
Match each learning-curve element to its use when thinking about the value of additional data.
Arrange the steps for judging whether more data may help a model.
How does training error help assess the value of more data?
Estimating the Benefit of More Data
Why add a training-error curve?
What extra plot helps judge the value of collecting more data?
Training loss can help interpret a validation-loss curve when estimating the value of more data.