Addressing Simultaneous Bias and Variance Issues
Question: Explain what a learning curve looks like when an algorithm has both high bias and high variance, and what general conclusion must be drawn about next steps for the algorithm.
Sample answer: The learning curve will show a training error that is large, meaning it is much higher than the desired level of performance, which indicates high bias. Additionally, the dev error will be much larger than the training error, which indicates high variance. The conclusion drawn from this pattern is that you will have to find a way to reduce both bias and variance in your algorithm.
Key points:
- Training error is much higher than desired performance.
- Dev error is much higher than training error.
- Algorithm changes must aim to reduce both bias and variance.
Rubric: A strong answer must clearly state the relationship between training error and desired performance (high bias), the relationship between dev error and training error (high variance), and the required action (reducing both).
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Identifying Simultaneous High Bias and High Variance
Dev Error in High Bias and Variance Scenarios
Necessary Algorithmic Adjustments for _____ Problem
Interpreting Learning Curve Components
Steps for Diagnosing High Bias and Variance
Addressing Simultaneous Bias and Variance Issues
Diagnostic Report on a New System
Recognizing the Dual Problem Pattern
Action Required for High Bias and Variance
Training Error Indicator for Bias