Time-independent Generalization Bounds for SGLD in Non-convex Settings

25 November 2021

Papers citing "Time-independent Generalization Bounds for SGLD in Non-convex Settings"

21 / 21 papers shown

Title
Understanding the Generalization Error of Markov algorithms through Poissonization Benjamin Dupuis Maxime Haddouche George Deligiannidis Umut Simsekli 49 0 0 11 Feb 2025
Provable Accuracy Bounds for Hybrid Dynamical Optimization and Sampling Matthew Burns Qingyuan Hou Michael Huang 197 1 0 08 Oct 2024
Generalization Error Matters in Decentralized Learning Under Byzantine Attacks Haoxiang Ye Qing Ling 39 0 0 11 Jul 2024
Information-theoretic Generalization Analysis for Expected Calibration Error Futoshi Futami Masahiro Fujisawa UQCV CML 41 1 0 24 May 2024
Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Sets Benjamin Dupuis Paul Viallard George Deligiannidis Umut Simsekli 48 2 0 26 Apr 2024
Convex SGD: Generalization Without Early Stopping Julien Hendrickx A. Olshevsky MLT LRM 25 1 0 08 Jan 2024
Time-Independent Information-Theoretic Generalization Bounds for SGLD Futoshi Futami Masahiro Fujisawa 44 5 0 02 Nov 2023
Generalization Bounds for Label Noise Stochastic Gradient Descent Jung Eun Huh Patrick Rebeschini 13 1 0 01 Nov 2023
Uniform-in-Time Wasserstein Stability Bounds for (Noisy) Stochastic Gradient Descent Lingjiong Zhu Mert Gurbuzbalaban Anant Raj Umut Simsekli 34 6 0 20 May 2023
Select without Fear: Almost All Mini-Batch Schedules Generalize Optimally Konstantinos E. Nikolakakis Amin Karbasi Dionysis Kalogerias 37 5 0 03 May 2023
Towards a Complete Analysis of Langevin Monte Carlo: Beyond Poincaré Inequality Alireza Mousavi-Hosseini Tyler Farghly Ye He Krishnakumar Balasubramanian Murat A. Erdogdu 45 26 0 07 Mar 2023
Algorithmic Stability of Heavy-Tailed SGD with General Loss Functions Anant Raj Lingjiong Zhu Mert Gurbuzbalaban Umut Simsekli 34 15 0 27 Jan 2023
Geometric ergodicity of SGLD via reflection coupling Lei Li Jian‐Guo Liu Yuliang Wang 47 2 0 17 Jan 2023
Neural Networks Efficiently Learn Low-Dimensional Representations with SGD Alireza Mousavi-Hosseini Sejun Park M. Girotti Ioannis Mitliagkas Murat A. Erdogdu MLT 324 48 0 29 Sep 2022
Generalisation under gradient descent via deterministic PAC-Bayes Eugenio Clerico Tyler Farghly George Deligiannidis Benjamin Guedj Arnaud Doucet 31 4 0 06 Sep 2022
A sharp uniform-in-time error estimate for Stochastic Gradient Langevin Dynamics Lei Li Yuliang Wang 39 11 0 19 Jul 2022
Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares Anant Raj Melih Barsbey Mert Gurbuzbalaban Lingjiong Zhu Umut Simsekli 19 9 0 02 Jun 2022
Beyond Lipschitz: Sharp Generalization and Excess Risk Bounds for Full-Batch GD Konstantinos E. Nikolakakis Farzin Haddadpour Amin Karbasi Dionysios S. Kalogerias 43 17 0 26 Apr 2022
Black-Box Generalization: Stability of Zeroth-Order Learning Konstantinos E. Nikolakakis Farzin Haddadpour Dionysios S. Kalogerias Amin Karbasi MLT 24 2 0 14 Feb 2022
Stability Based Generalization Bounds for Exponential Family Langevin Dynamics A. Banerjee Tiancong Chen Xinyan Li Yingxue Zhou 34 8 0 09 Jan 2022
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 115 147 0 06 Nov 2019