55
0

Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes [conference paper]

Abstract

In this article we propose a novel method for sampling from Gibbs distributions of the form π(x)exp(U(x))\pi(x)\propto\exp(-U(x)) with a potential U(x)U(x). In particular, inspired by diffusion models we propose to consider a sequence (πtk)k(\pi^{t_k})_k of approximations of the target density, for which πtkπ\pi^{t_k}\approx \pi for kk small and, on the other hand, πtk\pi^{t_k} exhibits favorable properties for sampling for kk large. This sequence is obtained by replacing parts of the potential UU by its Moreau envelopes. Sampling is performed in an Annealed Langevin type procedure, that is, sequentially sampling from πtk\pi^{t_k} for decreasing kk, effectively guiding the samples from a simple starting density to the more complex target. In addition to a theoretical analysis we show experimental results supporting the efficacy of the method in terms of increased convergence speed and applicability to multi-modal densities π\pi.

View on arXiv
@article{habring2025_2502.01358,
  title={ Diffusion at Absolute Zero: Langevin Sampling Using Successive Moreau Envelopes [conference paper] },
  author={ Andreas Habring and Alexander Falk and Thomas Pock },
  journal={arXiv preprint arXiv:2502.01358},
  year={ 2025 }
}
Comments on this paper