v1v2v3v4 (latest)

Data-Dependent Stability of Stochastic Gradient Descent

5 March 2017

Papers citing "Data-Dependent Stability of Stochastic Gradient Descent"

22 / 22 papers shown

Title
Learning Variational Inequalities from Data: Fast Generalization Rates under Strong Monotonicity Eric Zhao Tatjana Chavdarova Michael I. Jordan 102 0 0 20 Feb 2025
Stability and Generalization of Quantum Neural Networks Jiaqi Yang Wei Xie Xiaohua Xu 72 1 0 22 Jan 2025
Understanding Generalization of Federated Learning: the Trade-off between Model Stability and Optimization Dun Zeng Zheshun Wu Shiyu Liu Yu Pan Xiaoying Tang Zenglin Xu MLT FedML 140 1 0 25 Nov 2024
Stability of Stochastic Gradient Descent on Nonsmooth Convex Losses Raef Bassily Vitaly Feldman Cristóbal Guzmán Kunal Talwar MLT 54 197 0 12 Jun 2020
Fast Rates for Empirical Risk Minimization of Strict Saddle Problems Alon Gonen Shai Shalev-Shwartz 78 30 0 16 Jan 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 345 4,629 0 10 Nov 2016
Entropy-SGD: Biasing Gradient Descent Into Wide Valleys Pratik Chaudhari A. Choromańska Stefano Soatto Yann LeCun Carlo Baldassi C. Borgs J. Chayes Levent Sagun R. Zecchina ODL 96 774 0 06 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 427 2,945 0 15 Sep 2016
Deep Learning without Poor Local Minima Kenji Kawaguchi ODL 221 925 0 23 May 2016
Stochastic Variance Reduction for Nonconvex Optimization Sashank J. Reddi Ahmed S. Hefny S. Sra Barnabás Póczós Alex Smola 101 604 0 19 Mar 2016
Variance Reduction for Faster Non-Convex Optimization Zeyuan Allen-Zhu Elad Hazan ODL 118 392 0 17 Mar 2016
Train faster, generalize better: Stability of stochastic gradient descent Moritz Hardt Benjamin Recht Y. Singer 116 1,242 0 03 Sep 2015
Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition Rong Ge Furong Huang Chi Jin Yang Yuan 140 1,059 0 06 Mar 2015
Fast Rates by Transferring from Auxiliary Hypotheses Ilja Kuzborskij Francesco Orabona 76 64 0 04 Dec 2014
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 261 1,200 0 30 Nov 2014
Simultaneous Model Selection and Optimization through Parameter-free Stochastic Learning Francesco Orabona 143 103 0 15 Jun 2014
Stochastic Optimization with Importance Sampling P. Zhao Tong Zhang 96 345 0 13 Jan 2014
A PAC-Bayesian bound for Lifelong Learning Anastasia Pentina Christoph H. Lampert CLL 83 210 0 12 Nov 2013
Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming Saeed Ghadimi Guanghui Lan ODL 122 1,555 0 22 Sep 2013
Online Learning, Stability, and Stochastic Gradient Descent T. Poggio S. Voinea Lorenzo Rosasco 75 31 0 24 May 2011
Optimistic Rates for Learning with a Smooth Loss Nathan Srebro Karthik Sridharan Ambuj Tewari 163 283 0 20 Sep 2010
Empirical Bernstein Bounds and Sample Variance Penalization Andreas Maurer Massimiliano Pontil 402 545 0 21 Jul 2009