Learn Before
Concept

Energy Function of Centered Deep Boltzmann Machines

Considering a Boltzmann machine as a set of units xx with a weight matrix UU and biases bb, the standard energy function is given by: E(x)=xTUxbTxE(x) = -x^{T}Ux-b^{T}x. We can implement structures of Boltzmann machines with different numbers of layers by partitioning xx into visible and hidden units and zeroing out elements of UU for units that do not interact. A centered deep Boltzmann machine reparametrizes this energy function as: E^{'}(x;U,b) = -(x-mu)^{T}U(x-mu)-(x-mu)^{T}b. Typically, μ\mu is a hyperparameter fixed at the beginning of training, and it is usually chosen to ensure that xμ0x-\mu \approx 0 when the model is initialized.

0

1

Updated 2026-06-13

References


Tags

Data Science