Learn Before
Cost Function Smoothing in Continuation Methods
Continuation methods aim to minimize a complex cost function by constructing a sequence of increasingly difficult cost functions , where is the most smoothed (easiest to optimize) and is the original function. Smoothing is often achieved by "blurring" the cost function via sampling, such as approximating it with J^{(i)}(Theta)=mathop{mathbb{E}}_{Theta'simmathcal{N}(Theta';Theta,sigma^{(i)2})}J(Theta'). Optimization begins at , where the blurred non-convex space resembles a convex one, providing an effective initial starting point for the subsequent function . Iterating this process through typically yields a superior local minimum for the original optimization problem, though it does not guarantee finding the global minimum.

0
2
Contributors are:
Who are from:
Tags
Data Science