Concept

Basis Functions for Regression

The basis function approach to regression involves using a family of functions or transformations that can be applied to a variable XX: b1(X),b2(X),,bK(X)b_1(X), b_2(X), \cdots, b_K(X). Instead of fitting a standard linear model in XX, we fit the model: yi=β0+β1b1(xi)+β2b2(xi)++βKbK(xi)+ϵiy_i = \beta_0 + \beta_1b_1(x_i) + \beta_2b_2(x_i) + \cdots + \beta_Kb_K(x_i) + \epsilon_i. Note that the basis functions b1(),b2(),,bK()b_1(\cdot), b_2(\cdot), \cdots, b_K(\cdot) are fixed and known, meaning they are chosen ahead of time.

0

1

Updated 2026-06-15

Tags

Data Science