Learn Before
When Increasing Capacity Helps One Error and Hurts the Other
In many models, a change that makes the training fit more closely can also make the model less stable on new data. Adding more units, more layers, or extra input features often lowers bias because the model can represent a more complex pattern. The tradeoff is that variance may rise, which means the model can become more sensitive to quirks in the training set. Regularization usually pushes in the opposite direction: it often raises bias a little while reducing variance by limiting overfitting.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Bias (Informal Definition)
Variance, Informally
Some Data Should Be Left Out of Training
Mean Squared Error and the Bias-Variance Decomposition
Why Estimate the Lowest Plausible Error?
When Increasing Capacity Helps One Error and Hurts the Other
Validation-Error Learning Curve
Choosing Between Bias, Variance, and Dataset Mismatch Fixes
Diagnosing High Avoidable Bias from Similar Error Rates
A Single Model Can Show Several Error Sources at Once
A Big Gap Between Training and Development Error Suggests Overfitting
Reading High Bias from Training and Dev Error
A Model Can Show Both Bias and Variance
Strong Classification Performance Comes from Low Bias and Low Variance
What are the two main sources of error in machine learning?
Why can it be useful to tell whether a model's main problem is bias or variance before deciding how to improve it?
In the usual pair of major supervised-learning error sources, bias and ____ go together.
Which pair names the two broad error categories used to guide model improvement?
When a model's errors are due to bias or variance, that information helps you decide whether collecting more labels is likely to help.
Major error sources in supervised learning
Match Each Error-Analysis Idea to Its Role
Use bias and variance to choose an improvement strategy.
How can knowing the bias and variance pattern of your model help you make better decisions?
Sources of Error in Machine Learning Models
Knowing bias and variance helps you decide whether _____ is worth the effort.
Match each child concept to the bias-variance idea it supports.
Order the steps for deciding whether more labeled data is the right fix for a classifier.
Using Bias and Variance to Choose the Next Improvement
Choosing an Error Check Before Expanding the Dataset
Why Diagnose Bias and Variance Before Choosing an Improvement Strategy?
Learn After
Large Models and More Data Can Weaken the Tradeoff
What is a common effect of adding regularization to a learning algorithm?
True or False: Increasing a neural network’s width or depth often lowers bias, but it can also make overfitting more likely.
Why Bias and Variance Trade Off
What usually happens when you make a neural network larger?
Regularization usually reduces both bias and variance in a model.
Some model changes reduce _____ while often increasing variance, and other changes do the opposite.
Match each sign or adjustment to its role in the bias-variance tradeoff.
Arrange the steps a practitioner follows when using training and dev errors to choose an improvement strategy.
A model is underfitting its training data. Which change is most likely to help?
Lowering one source of error in a model always lowers every other source of error as well.
Effect of regularization on bias and variance
Match each bias-variance concept to its description in practice
Order the steps for deciding whether to increase capacity or strengthen regularization when a model is not performing well.
How do extra predictors and regularization affect bias and variance?
Effect of model expansion versus regularization on overfitting
How do bias and variance move when a learning system changes?