Variance reduction for Riemannian non-convex optimization with batch
size adaptation

Variance reduction for Riemannian non-convex optimization with batch size adaptation

3 July 2020

Junbin Gao

Papers citing "Variance reduction for Riemannian non-convex optimization with batch size adaptation"

8 / 8 papers shown

Title
R-SPIDER: A Fast Riemannian Stochastic Optimization Algorithm with Curvature Independent Rate J.N. Zhang Hongyi Zhang S. Sra 43 39 0 10 Nov 2018
Riemannian Adaptive Optimization Methods Gary Bécigneul O. Ganea ODL 91 254 0 01 Oct 2018
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator Cong Fang C. J. Li Zhouchen Lin Tong Zhang 81 572 0 04 Jul 2018
Don't Decay the Learning Rate, Increase the Batch Size Samuel L. Smith Pieter-Jan Kindermans Chris Ying Quoc V. Le ODL 95 990 0 01 Nov 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 375 2,922 0 15 Sep 2016
Riemannian SVRG: Fast Stochastic Optimization on Riemannian Manifolds Hongyi Zhang Sashank J. Reddi S. Sra 80 240 0 23 May 2016
SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives Aaron Defazio Francis R. Bach Simon Lacoste-Julien ODL 110 1,817 0 01 Jul 2014
Hybrid Deterministic-Stochastic Methods for Data Fitting M. Friedlander Mark Schmidt 151 387 0 13 Apr 2011