Improved Analysis and Rates for Variance Reduction under
Without-replacement Sampling Orders

Improved Analysis and Rates for Variance Reduction under Without-replacement Sampling Orders

25 April 2021

Papers citing "Improved Analysis and Rates for Variance Reduction under Without-replacement Sampling Orders"

18 / 18 papers shown

Title
Random Reshuffling with Variance Reduction: New Analysis and Better Rates Grigory Malinovsky Alibek Sailanbayev Peter Richtárik 41 20 0 19 Apr 2021
Proximal and Federated Random Reshuffling Konstantin Mishchenko Ahmed Khaled Peter Richtárik FedML 54 31 0 12 Feb 2021
Understanding the Impact of Model Incoherence on Convergence of Incremental SGD with Random Reshuffle Shaocong Ma Yi Zhou 34 3 0 07 Jul 2020
Random Reshuffling: Simple Analysis with Vast Improvements Konstantin Mishchenko Ahmed Khaled Peter Richtárik 62 131 0 10 Jun 2020
Closing the convergence gap of SGD without replacement Shashank Rajput Anant Gupta Dimitris Papailiopoulos 44 61 0 24 Feb 2020
General Proximal Incremental Aggregated Gradient Algorithms: Better and Novel Results under General Scheme Tao Sun Yuejiao Sun Dongsheng Li Qing Liao 47 16 0 11 Oct 2019
How Good is SGD with Random Shuffling? Itay Safran Ohad Shamir 44 81 0 31 Jul 2019
SGD without Replacement: Sharper Rates for General Smooth Convex Functions Prateek Jain Dheeraj M. Nagaraj Praneeth Netrapalli 50 87 0 04 Mar 2019
Random Shuffling Beats SGD after Finite Epochs Jeff Z. HaoChen S. Sra 49 98 0 26 Jun 2018
Stochastic Learning under Random Reshuffling with Constant Step-sizes Bicheng Ying Kun Yuan Stefan Vlaski Ali H. Sayed 55 36 0 21 Mar 2018
Cyclic Coordinate Update Algorithms for Fixed-Point Problems: Analysis and Applications Y. T. Chow Tianyu Wu W. Yin 47 26 0 08 Nov 2016
Surpassing Gradient Descent Provably: A Cyclic Incremental Method with Linear Convergence Rate Aryan Mokhtari Mert Gurbuzbalaban Alejandro Ribeiro 92 36 0 01 Nov 2016
Optimization Methods for Large-Scale Machine Learning Léon Bottou Frank E. Curtis J. Nocedal 209 3,202 0 15 Jun 2016
Finito: A Faster, Permutable Incremental Gradient Method for Big Data Problems Aaron Defazio T. Caetano Justin Domke 102 169 0 10 Jul 2014
SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives Aaron Defazio Francis R. Bach Simon Lacoste-Julien ODL 125 1,823 0 01 Jul 2014
Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning Julien Mairal 138 318 0 18 Feb 2014
Stochastic Optimization with Importance Sampling P. Zhao Tong Zhang 82 344 0 13 Jan 2014
Minimizing Finite Sums with the Stochastic Average Gradient Mark Schmidt Nicolas Le Roux Francis R. Bach 289 1,246 0 10 Sep 2013