Accelerating Stochastic Gradient Descent For Least Squares Regression

26 April 2017

Papers citing "Accelerating Stochastic Gradient Descent For Least Squares Regression"

22 / 22 papers shown

Title
Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD than Constant Stepsize Mert Gurbuzbalaban Yuanhan Hu Umut Simsekli Lingjiong Zhu LRM 28 1 0 10 Feb 2023
Policy Search using Dynamic Mirror Descent MPC for Model Free Off Policy RL Aarush Gupta 30 0 0 23 Oct 2021
COCO Denoiser: Using Co-Coercivity for Variance Reduction in Stochastic Convex Optimization Manuel Madeira Renato M. P. Negrinho J. Xavier P. Aguiar 31 0 0 07 Sep 2021
Anytime Minibatch with Delayed Gradients H. Al-Lawati S. Draper 25 0 0 15 Dec 2020
Federated Composite Optimization Honglin Yuan Manzil Zaheer Sashank J. Reddi FedML 37 58 0 17 Nov 2020
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 30 168 0 19 Dec 2019
The Wang-Landau Algorithm as Stochastic Optimization and Its Acceleration Chenguang Dai Jun S. Liu 29 4 0 27 Jul 2019
Reducing the variance in online optimization by transporting past gradients Sébastien M. R. Arnold Pierre-Antoine Manzagol Reza Babanezhad Ioannis Mitliagkas Nicolas Le Roux 26 28 0 08 Jun 2019
The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares Rong Ge Sham Kakade Rahul Kidambi Praneeth Netrapalli 37 150 0 29 Apr 2019
Memory-Sample Tradeoffs for Linear Regression with Small Error Vatsal Sharan Aaron Sidford Gregory Valiant 23 35 0 18 Apr 2019
A Selective Overview of Deep Learning Jianqing Fan Cong Ma Yiqiao Zhong BDL VLM 38 136 0 10 Apr 2019
A Universally Optimal Multistage Accelerated Stochastic Gradient Method N. Aybat Alireza Fallah Mert Gurbuzbalaban Asuman Ozdaglar ODL 29 57 0 23 Jan 2019
Accelerated Linear Convergence of Stochastic Momentum Methods in Wasserstein Distances Bugra Can Mert Gurbuzbalaban Lingjiong Zhu 21 45 0 22 Jan 2019
Accelerated Flow for Probability Distributions Amirhossein Taghvaei P. Mehta 47 31 0 10 Jan 2019
Quasi-hyperbolic momentum and Adam for deep learning Jerry Ma Denis Yarats ODL 84 129 0 16 Oct 2018
Optimal Adaptive and Accelerated Stochastic Gradient Descent Qi Deng Yi Cheng Guanghui Lan 16 8 0 01 Oct 2018
Optimal Matrix Momentum Stochastic Approximation and Applications to Q-learning Adithya M. Devraj Ana Bušić Sean P. Meyn 22 4 0 17 Sep 2018
On the insufficiency of existing momentum schemes for Stochastic Optimization Rahul Kidambi Praneeth Netrapalli Prateek Jain Sham Kakade ODL 32 117 0 15 Mar 2018
Accelerated Gradient Boosting Gérard Biau B. Cadre L. Rouviere 24 108 0 06 Mar 2018
Accelerated Stochastic Power Iteration Christopher De Sa Bryan D. He Ioannis Mitliagkas Christopher Ré Peng Xu 43 89 0 10 Jul 2017
Stochastic Heavy Ball S. Gadat Fabien Panloup Sofiane Saadane 18 103 0 14 Sep 2016
Fast Incremental Method for Nonconvex Optimization Sashank J. Reddi S. Sra Barnabás Póczós Alex Smola 33 44 0 19 Mar 2016