Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations

5 November 2018

Papers citing "Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations"

8 / 8 papers shown

Title
Convergence, Sticking and Escape: Stochastic Dynamics Near Critical Points in SGD Dmitry Dudukalov Artem Logachov Vladimir Lotov Timofei Prasolov Evgeny Prokopenko Anton Tarasenko 17 0 0 24 May 2025
Noise-Aware Differentially Private Variational Inference Talal Alrawajfeh Hibiki Ito Antti Honkela 90 0 0 25 Oct 2024
Dynamics of Supervised and Reinforcement Learning in the Non-Linear Perceptron Christian Schmid James M. Murray 52 0 0 05 Sep 2024
Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework Siyuan Yu Wei Chen H. V. Poor 63 0 0 17 Jun 2024
The Implicit Regularization of Stochastic Gradient Flow for Least Squares Alnur Ali Yan Sun Robert Tibshirani 51 77 0 17 Mar 2020
A Variational Analysis of Stochastic Gradient Algorithms Stephan Mandt Matthew D. Hoffman David M. Blei 39 157 0 08 Feb 2016
A Proximal Stochastic Gradient Method with Progressive Variance Reduction Lin Xiao Tong Zhang ODL 140 738 0 19 Mar 2014
Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes Ohad Shamir Tong Zhang 134 573 0 08 Dec 2012