Learn Before
Concept

The Partition Function (introduction).

The partition function is an integral or sum over unnormalized probabilities. This function, often denoted by Z, is used to normalize an unnormalized distribution into a valid distribution. p(x)=1Zp~(x).p(\textbf{x}) = \frac{1}{Z} \tilde{p}(\textbf{x}) .

where Z is:

Z=p~(x)dx.Z = \int \tilde{p}(\textbf{x}) d\textbf{x}. or Z=xp~(x)dx.Z = \sum_{x} \tilde{p}(\textbf{x}) d\textbf{x}.

Z = partition function.
p~(x)\tilde{p}(\textbf{x}) = Unnormalized distribution. p(x)p(\textbf{x}) = Normalized distribution. In the context of deep learning, Z is usually intractable, meaning that it often needs to be approximated.

0

2

Updated 2026-01-15

Tags

Data Science

Foundations of Large Language Models Course

Computing Sciences