70
0

Non-convex sampling for a mixture of locally smooth potentials

Abstract

The purpose of this paper is to examine the sampling problem through Euler discretization, where the potential function is assumed to be a mixture of locally smooth distributions and weakly dissipative. We introduce αG\alpha_{G}-mixture locally smooth and αH\alpha_{H}-mixture locally Hessian smooth, which are novel and typically satisfied with a mixture of distributions. Under our conditions, we prove the convergence in Kullback-Leibler (KL) divergence with the number of iterations to reach ϵ\epsilon-neighborhood of a target distribution in only polynomial dependence on the dimension. The convergence rate is improved when the potential is 11-smooth and αH\alpha_{H}-mixture locally Hessian smooth. Our result for the non-strongly convex outside the ball of radius RR is obtained by convexifying the non-convex domains. In addition, we provide some nice theoretical properties of pp-generalized Gaussian smoothing and prove the convergence in the LβL_{\beta}-Wasserstein distance for stochastic gradients in a general setting.

View on arXiv
Comments on this paper

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.