Case Study

Responding to a Negative Avoidable Bias Diagnosis

Case context: You are building a system that classifies medical reports. A human benchmark suggests that the best achievable error is about 4%. On the training set, your model is already at 2% error, which produces a negative avoidable bias calculation. A teammate recommends making the model even larger to push the error down further.

Question: What should you conclude from the negative avoidable bias result, and how should you respond to the recommendation?

Sample answer: The most likely interpretation is that the model is fitting the training data too closely, which points to overfitting rather than a need for more bias reduction. Because the training error is already below the estimated best achievable error, making the model even more complex is not the right next step. I should reject that recommendation and instead look for ways to reduce variance, such as using stronger regularization or other methods that improve generalization.

Key points:

  • The model is overfitting the training set.
  • The training error is unrealistically better than the benchmark estimate.
  • Do not respond by increasing model size to reduce bias.
  • Prioritize variance reduction methods instead.

Rubric: The response must identify overfitting as the main issue and recommend variance reduction instead of the proposed bias-reduction change.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI