Law of Balance and Stationary Distribution of Stochastic Gradient Descent

13 August 2023

Papers citing "Law of Balance and Stationary Distribution of Stochastic Gradient Descent"

8 / 8 papers shown

Title
Posterior Collapse of a Linear Latent Variable Model Zihao Wang Liu Ziyin BDL 51 22 0 09 May 2022
Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect Yuqing Wang Minshuo Chen T. Zhao Molei Tao AI4CE 68 40 0 07 Oct 2021
Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity Scott Pesme Loucas Pillaud-Vivien Nicolas Flammarion 39 100 0 17 Jun 2021
Implicit Gradient Regularization David Barrett Benoit Dherin 45 149 0 23 Sep 2020
Analysis of Stochastic Gradient Descent in Continuous Time J. Latz 47 38 0 15 Apr 2020
Is Local SGD Better than Minibatch SGD? Blake E. Woodworth Kumar Kshitij Patel Sebastian U. Stich Zhen Dai Brian Bullins H. B. McMahan Ohad Shamir Nathan Srebro FedML 42 254 0 18 Feb 2020
The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning Siyuan Ma Raef Bassily M. Belkin 41 289 0 18 Dec 2017
Stochastic Gradient Descent as Approximate Bayesian Inference Stephan Mandt Matthew D. Hoffman David M. Blei BDL 32 594 0 13 Apr 2017