35
2

On theoretical guarantees and a blessing of dimensionality for nonconvex sampling

Abstract

Existing guarantees for algorithms sampling from nonlogconcave measures on Rd\mathbb{R}^d are generally inexplicit or unscalable. Even for the class of measures with logdensities that have bounded Hessians and are strongly concave outside a Euclidean ball of radius RR, no available theory is comprehensively satisfactory with respect to both RR and dd. In this paper, it is shown that complete polynomial complexity can in fact be achieved if RcdR\leq c\sqrt{d}, whilst an exponential number of point evaluations is generally necessary for any algorithm as soon as RCdR\geq C\sqrt{d} for constants C>c>0C>c>0. A simple importance sampler with tail-matching proposal achieves the former, owing to a blessing of dimensionality. On the other hand, if strong concavity outside a ball is replaced by a distant dissipativity condition, then sampling guarantees must generally scale exponentially with dd in all parameter regimes.

View on arXiv
Comments on this paper