Learn Before
Concept
Calculations for Inference Optimization
The bound is defined as: , where is an arbitrary probability distribution over . always has at most the same value as the desired log-probability, since the difference between and is given by the KL divergence, which is always nonnegative. The two are equal if and only if is the same distribution as . can be rearranged through algebra into the simpler form . Thus, we can think of inference as the procedure for finding the that maximizes .
0
1
Updated 2021-07-29
Tags
Data Science