Learn Before
Concept

Lasso Regression

Lasso Regression is similar to ridge regression, but instead we use the L1 regularization penalty. This has the effect of setting some coefficient estimates to exactly zero for the least influential variables, which leads to models only including a subset of variables. This is called a space solution, which is a kind of feature selection. The parameter α\alpha controls the amount of L1 regularization (default = 1.0). The prediction formula is the same as OLS.

i=1n(yiβ0j=1pβjxij)2+λj=1pβj=RSS+λj=1pβj.\sum_{i=1}^{n} ({y}_{i}-{\beta}_{0}-\sum_{j=1}^{p}{\beta}_{j}{x}_{ij})^2 +\lambda\sum_{j=1}^{p}\vert{\beta}_{j}\vert=RSS+\lambda\sum_{j=1}^{p}\vert{\beta}_{j}\vert.

0

3

Updated 2026-05-03

Tags

Data Science

D2L

Dive into Deep Learning @ D2L

Related