Learn Before
When Additional Data Helps Reduce Variance
Question: When is collecting more training data a practical way to reduce high variance, and what usually happens to bias when you do this?
Sample answer: Adding more training examples can help with high variance when you can obtain a substantially larger dataset and you have enough computing resources to train on it. This approach usually lowers variance, but it does not meaningfully change bias.
Key points:
- More data is only practical when a much larger dataset is available.
- Sufficient computing resources are needed to use the extra data.
- More training data usually reduces variance.
- More training data usually leaves bias unchanged.
Rubric: The response must state that adding data is useful only when significantly more data and enough computation are available. It must also explain that this typically reduces variance without changing bias.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What effect does adding more training data usually have on a model that has high variance?
True or False: When a model shows high variance, collecting additional training examples is a dependable way to reduce overfitting.
Adding more training data can usually reduce variance without changing bias much
A classifier has high variance. What is usually the simplest and most dependable first fix?
True or False: Adding more training examples usually lowers variance and also lowers bias.
Fill in the blank: One of the simplest and most _____ ways to address high variance is to add more training examples.
Match each concept to its role when extra training data is used to reduce variance.
Order the steps a practitioner follows before using more training examples to address overfitting.
When is collecting additional training data a practical way to reduce variance?
True or False: For a model with high variance, collecting more training examples should be considered only after every other remedy has already been tried.
Adding more training examples usually reduces _____ without changing bias much.
Match each description to Andrew Ng’s view of adding more training data as a remedy for high variance.
Order the checks used to confirm that more training data reduced variance without raising bias
When Additional Data Helps Reduce Variance
Should Extra Labeled Data Be Added to a High-Variance Bird Call Classifier?
How More Training Data Affects Bias