Architectural Changes Can Lower Bias and Variance Together
Some improvements act on both bias and variance at the same time because they change the structure of the model or system rather than only tuning parameters. Choosing an architecture that fits the task well is a common example: it can reduce underfitting and also make the system less sensitive to the training sample. The challenge is that good architecture choices are often harder to discover and implement than simpler fixes.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Architectural Changes Can Lower Bias and Variance Together
Basic Bias and Variance Remedies
Changing Architecture Can Shift Both Error Sources
Why is it useful to diagnose which source of error is larger in an ML project?
Methods that lower bias in a model will always lower its variance too.
Building intuition about _____ and variance helps you decide which change will improve a model.
Match each observation or action to the error issue it mainly helps diagnose or improve.
Determine the Main Source of Error in a Machine Learning Model
Which two error rates are most useful for diagnosing bias and variance?
Reviewing your model's error patterns can help you decide whether to focus on data mismatch.
Bias and variance require different remedies
Match each error pattern to the most likely model issue.
Order the reasoning steps for deciding whether bias or variance is the bigger issue.
Using Error Breakdown to Decide What to Fix First
First Priority for a Fraud Detector with High Underfitting
Using Error Diagnosis to Set the Next Priority
Learn After
Which change can lower both bias and variance?
Methods That Improve Both Bias and Variance
How a well-matched architecture can improve both errors
Match architecture choices with their effects
Sequence of steps for reducing both kinds of error with architecture changes
How architecture changes can lower bias and variance together
Choosing a New Model Design for a Forecasting Task
Why are architecture changes hard to use for reducing both bias and variance?
What can happen when you choose a model architecture that matches the task?
Major architecture changes can reduce both bias and variance