Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent

14 February 2023

Papers citing "Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent"

7 / 7 papers shown

Title
Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning Dennis Chemnitz Maximilian Engel 25 0 0 29 Jul 2024
Unlocking optimal batch size schedules using continuous-time control and perturbation theory Stefan Perko 19 2 0 04 Dec 2023
Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation Markus Gross A. Raulf Christoph Räth 38 0 0 23 Nov 2023
On uniform-in-time diffusion approximation for stochastic gradient descent Lei Li Yuliang Wang 48 3 0 11 Jul 2022
Trajectory-dependent Generalization Bounds for Deep Neural Networks via Fractional Brownian Motion Chengli Tan Jiang Zhang Junmin Liu 35 1 0 09 Jun 2022
What Happens after SGD Reaches Zero Loss? --A Mathematical Framework Zhiyuan Li Tianhao Wang Sanjeev Arora MLT 88 98 0 13 Oct 2021
Trainability and Accuracy of Neural Networks: An Interacting Particle System Approach Grant M. Rotskoff Eric Vanden-Eijnden 59 118 0 02 May 2018