Generalization Properties and Implicit Regularization for Multiple Passes SGM

26 May 2016

Papers citing "Generalization Properties and Implicit Regularization for Multiple Passes SGM"

11 / 11 papers shown

Title
Convex SGD: Generalization Without Early Stopping Julien Hendrickx A. Olshevsky MLT LRM 25 1 0 08 Jan 2024
Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD than Constant Stepsize Mert Gurbuzbalaban Yuanhan Hu Umut Simsekli Lingjiong Zhu LRM 23 1 0 10 Feb 2023
High Probability Bounds for Stochastic Subgradient Schemes with Heavy Tailed Noise D. A. Parletta Andrea Paudice Massimiliano Pontil Saverio Salzo 47 9 0 17 Aug 2022
Overview frequency principle/spectral bias in deep learning Z. Xu Yaoyu Zhang Tao Luo FaML 33 66 0 19 Jan 2022
Improved Learning Rates for Stochastic Optimization: Two Theoretical Viewpoints Shaojie Li Yong Liu 26 13 0 19 Jul 2021
Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent Yunwen Lei Yiming Ying MLT 35 126 0 15 Jun 2020
Implicit Regularization in Deep Matrix Factorization Sanjeev Arora Nadav Cohen Wei Hu Yuping Luo AI4CE 38 491 0 31 May 2019
Graph-Dependent Implicit Regularisation for Distributed Stochastic Subgradient Descent Dominic Richards Patrick Rebeschini 16 18 0 18 Sep 2018
Convergence of Unregularized Online Learning Algorithms Yunwen Lei Lei Shi Zheng-Chu Guo 22 14 0 09 Aug 2017
Alternative asymptotics for cointegration tests in large VARs Junhong Lin Lorenzo Rosasco 23 37 0 28 May 2016
Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes Ohad Shamir Tong Zhang 101 571 0 08 Dec 2012