Variance reduction for Riemannian non-convex optimization with batch
size adaptation

Variance reduction for Riemannian non-convex optimization with batch size adaptation

3 July 2020

Junbin Gao

Papers citing "Variance reduction for Riemannian non-convex optimization with batch size adaptation"

8 / 8 papers shown

Title
R-SPIDER: A Fast Riemannian Stochastic Optimization Algorithm with Curvature Independent Rate J.N. Zhang Hongyi Zhang S. Sra 43 39 0 10 Nov 2018
Riemannian Adaptive Optimization Methods Gary Bécigneul O. Ganea ODL 91 254 0 01 Oct 2018
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator Cong Fang C. J. Li Zhouchen Lin Tong Zhang 81 572 0 04 Jul 2018
Don't Decay the Learning Rate, Increase the Batch Size Samuel L. Smith Pieter-Jan Kindermans Chris Ying Quoc V. Le ODL 93 990 0 01 Nov 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 375 2,922 0 15 Sep 2016
Riemannian SVRG: Fast Stochastic Optimization on Riemannian Manifolds Hongyi Zhang Sashank J. Reddi S. Sra 80 240 0 23 May 2016
SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives Aaron Defazio Francis R. Bach Simon Lacoste-Julien ODL 110 1,817 0 01 Jul 2014
Hybrid Deterministic-Stochastic Methods for Data Fitting M. Friedlander Mark Schmidt 142 387 0 13 Apr 2011

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.