Learn Before
Concept

Probabilistic PCA

Probabilistic PCA is a dimensionality reduction technique that analyzes data via a lower-dimensional latent space. The PCA probability model is a slightly modified factor analysis model that uses WWT+σ2I\textbf{W}\textbf{W}^{T} + \sigma^{2}\textbf{I} as the covariance of x\textbf{x}, where σ2\sigma^{2} is a scalar:

textbf{x} sim N(textbf{x}; textbf{b}, textbf{W}textbf{W}^{T} + sigma^{2}textbf{I})

which can be equivalently expressed as:

x=Wh+b+σz\textbf{x} = \textbf{W}\textbf{h} + \textbf{b} + \sigma \textbf{z}

where textbf{z} sim N(textbf{z}; 0, textbf{I}) is noise, x\textbf{x} is a data vector, h\textbf{h} is a latent variable, and W\textbf{W} is a matrix of principal axes relating the latent variables to the data.

0

0

Updated 2026-06-17

References


Tags

Data Science