Learn Before
Why might a model get 0% training error on only two samples?
Question: Answer in one to three sentences.
Sample answer: With only two training cases, a sufficiently flexible model can simply fit both of them exactly. Because it has effectively memorized those examples, it can reach zero training error.
Key points:
- The training set is tiny.
- A flexible learner can memorize the examples.
- Perfect memorization can lead to 0% training error.
Rubric: The answer should explain that such a small dataset is easy to memorize and that memorization can produce zero training error.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What usually happens to training error as the training set becomes larger?
A very small training set can make a model seem impressively accurate on training data.
Training Error and More Data
Match each training-data situation with its typical effect on error.
Order the reasoning that explains why training error can increase.
Why can training error go up even as dev error goes down?
Explain the error trend after expanding a dataset
Why might a model get 0% training error on only two samples?
Which learning-curve trend is most typical when the training set gets larger?
Training error must always stay the same or decrease as the training set gets larger.