Learn Before
Concept icon
Concept

Regularization Lowers Variance but Raises Bias

Methods such as L2 penalties, L1 penalties, and dropout usually make a model less sensitive to the training set, which lowers variance. The trade-off is that the model is also constrained more strongly, so its bias tends to increase.

0

1

Concept icon
Updated 2026-08-12

Contributors are:

Who are from:

Tags

Data Science

D2L

Dive into Deep Learning @ D2L

Machine Learning

Deep Learning

Supervised Learning

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI