Responding to a Negative Avoidable Bias Diagnosis
Case context: You are building a system that classifies medical reports. A human benchmark suggests that the best achievable error is about 4%. On the training set, your model is already at 2% error, which produces a negative avoidable bias calculation. A teammate recommends making the model even larger to push the error down further.
Question: What should you conclude from the negative avoidable bias result, and how should you respond to the recommendation?
Sample answer: The most likely interpretation is that the model is fitting the training data too closely, which points to overfitting rather than a need for more bias reduction. Because the training error is already below the estimated best achievable error, making the model even more complex is not the right next step. I should reject that recommendation and instead look for ways to reduce variance, such as using stronger regularization or other methods that improve generalization.
Key points:
- The model is overfitting the training set.
- The training error is unrealistically better than the benchmark estimate.
- Do not respond by increasing model size to reduce bias.
- Prioritize variance reduction methods instead.
Rubric: The response must identify overfitting as the main issue and recommend variance reduction instead of the proposed bias-reduction change.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What does negative avoidable bias indicate?
What to Do When Avoidable Bias Is Negative
Negative Avoidable Bias and Overfitting
Ideas Connected to Negative Avoidable Bias
How to interpret a negative gap to the best achievable error
Meaning of Negative Avoidable Bias
Responding to a Negative Avoidable Bias Diagnosis
What to Do When Avoidable Bias Is Negative
Interpreting Negative Avoidable Bias
A model with negative avoidable bias is still underfitting the training set.