Learn Before
Concept icon
Concept

A Negative Gap to the Best Achievable Error Usually Signals Memorization

If the avoidable-bias value is below zero, the model is performing better on the training set than the benchmark for the best achievable error. That is a sign that the model is fitting the training set too closely and has likely memorized it. In that situation, the next priority is usually to reduce variance instead of spending more effort on lowering bias.

0

1

Concept icon
Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI