71
5

On quantitative Laplace-type convergence results for some exponential probability measures, with two applications

Abstract

Laplace-type results characterize the limit of sequence of measures (πε)ε>0(\pi_\varepsilon)_{\varepsilon >0} with density w.r.t the Lebesgue measure (dπε/dLeb)(x)exp[U(x)/ε](\mathrm{d} \pi_\varepsilon / \mathrm{d} \mathrm{Leb})(x) \propto \exp[-U(x)/\varepsilon] when the temperature ε>0\varepsilon>0 converges to 00. If a limiting distribution π0\pi_0 exists, it concentrates on the minimizers of the potential UU. Classical results require the invertibility of the Hessian of UU in order to establish such asymptotics. In this work, we study the particular case of norm-like potentials UU and establish quantitative bounds between πε\pi_\varepsilon and π0\pi_0 w.r.t. the Wasserstein distance of order 11 under an invertibility condition of a generalized Jacobian. One key element of our proof is the use of geometric measure theory tools such as the coarea formula. We apply our results to the study of maximum entropy models (microcanonical/macrocanonical distributions) and to the convergence of the iterates of the Stochastic Gradient Langevin Dynamics (SGLD) algorithm at low temperatures for non-convex minimization.

View on arXiv
Comments on this paper