Optimal Error Rate Changes How Training Error Is Interpreted
The same training error can mean very different things depending on the best achievable error. If the best possible error is near 0%, a training error of 15% leaves substantial room to improve the model. If the best possible error is around 14%, the same 15% training error suggests only a small gap remains, so there is little avoidable bias left to reduce.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
Optimal Error Rate Changes How Training Error Is Interpreted
What Is Irreducible Error?
Optimal Error Rate and Avoidable Bias
An Optimal Error Rate Reflects _____ Bias
Match the error terms to their meanings.
Recognizing the Irreducible Error Floor in a New Task
Interpreting Irreducible Error in Model Evaluation
Separating Irreducible Error from Remediable Error in a Document Classifier
The Error That Cannot Be Reduced Further
What Does a 14% Error Floor Represent?
Unavoidable bias is mainly a useful idea when the best possible error is already close to zero.
Learn After
Judging Avoidable Bias from the Training Set
A model with 8% training error and 7% best achievable error shows strong evidence of high bias.
Room to Improve When the Best Possible Error Is Near Zero
Matching Bias Clues to Error Gaps
Diagnosing Bias by Comparing Training Error to a Practical Baseline
Why the Same Training Error Can Mean Different Things
Estimating Bias From Training Error and a Human Performance Baseline
What Does a Large Gap Between Training Error and Best Possible Error Suggest?
How to judge whether there is still room to reduce avoidable bias
Can training error by itself tell you whether a bias-reducing change is worthwhile?