Surpassing Gradient Descent Provably: A Cyclic Incremental Method with
Linear Convergence Rate

Surpassing Gradient Descent Provably: A Cyclic Incremental Method with Linear Convergence Rate

1 November 2016

Mert Gurbuzbalaban

Alejandro Ribeiro

Papers citing "Surpassing Gradient Descent Provably: A Cyclic Incremental Method with Linear Convergence Rate"

7 / 7 papers shown

Title
High Probability Guarantees for Random Reshuffling Hengxu Yu Xiao Li 45 2 0 20 Nov 2023
SPIRAL: A superlinearly convergent incremental proximal algorithm for nonconvex finite sum minimization Pourya Behmandpoor P. Latafat Andreas Themelis Marc Moonen Panagiotis Patrinos 29 2 0 17 Jul 2022
Federated Random Reshuffling with Compression and Variance Reduction Grigory Malinovsky Peter Richtárik FedML 27 10 0 08 May 2022
Random-reshuffled SARAH does not need a full gradient computations Aleksandr Beznosikov Martin Takáč 26 7 0 26 Nov 2021
Cyclic Coordinate Dual Averaging with Extrapolation Chaobing Song Jelena Diakonikolas 27 6 0 26 Feb 2021
A Proximal Stochastic Gradient Method with Progressive Variance Reduction Lin Xiao Tong Zhang ODL 93 737 0 19 Mar 2014
Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning Julien Mairal 79 317 0 18 Feb 2014