Relation

Score Matching

Score matching helps to train a neural network model without evaluating the partition function , ZZ or its derivative. The strategy used is to minimize the expected squared difference between the derivatives of the model's log density with respect to the input and the derivatives of the data's log density with respect to the input.

L(x,θ)=12xlogpmodel(x;θ),xlogpdata(x)22L(x,\theta) = \frac{1}{2} \| \nabla_x \log p_{model}(x;\theta),- \nabla_x \log p_{data}(x) \|_{2}^{2}

J(θ)=12Epdata(x)L(x,θ) J(\theta) = \frac{1}{2} E_{p_{data}}(x)L(x,\theta)

θ=minθJ(θ)\theta^* = \min\limits_{\theta} J(\theta)

0

1

Updated 2021-07-22

References


Tags

Data Science