Variance Reduction for Faster Non-Convex Optimization

17 March 2016

Papers citing "Variance Reduction for Faster Non-Convex Optimization"

28 / 78 papers shown

Title
Analysis of nonsmooth stochastic approximation: the differential inclusion approach Szymon Majewski B. Miasojedow Eric Moulines 19 49 0 04 May 2018
Stochastic Variance-Reduced Hamilton Monte Carlo Methods Difan Zou Pan Xu Quanquan Gu BDL 27 31 0 13 Feb 2018
A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization Zhize Li Jian Li 39 116 0 13 Feb 2018
Katyusha X: Practical Momentum Method for Stochastic Sum-of-Nonconvex Optimization Zeyuan Allen-Zhu ODL 44 52 0 12 Feb 2018
Neon2: Finding Local Minima via First-Order Oracles Zeyuan Allen-Zhu Yuanzhi Li 21 130 0 17 Nov 2017
Continuous DR-submodular Maximization: Structure and Algorithms Yatao Bian Kfir Y. Levy Andreas Krause J. M. Buhmann 35 65 0 04 Nov 2017
Natasha 2: Faster Non-Convex Optimization Than SGD Zeyuan Allen-Zhu ODL 28 245 0 29 Aug 2017
Efficient Regret Minimization in Non-Convex Games Elad Hazan Karan Singh Cyril Zhang 19 94 0 31 Jul 2017
Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization Pan Xu Jinghui Chen Difan Zou Quanquan Gu 31 200 0 20 Jul 2017
A Unified Analysis of Stochastic Optimization Methods Using Jump System Theory and Quadratic Constraints Bin Hu Peter M. Seiler Anders Rantzer 30 35 0 25 Jun 2017
Stochastic Recursive Gradient Algorithm for Nonconvex Optimization Lam M. Nguyen Jie Liu K. Scheinberg Martin Takáč 11 94 0 20 May 2017
Data-Dependent Stability of Stochastic Gradient Descent Ilja Kuzborskij Christoph H. Lampert MLT 9 165 0 05 Mar 2017
Natasha: Faster Non-Convex Stochastic Optimization Via Strongly Non-Convex Parameter Zeyuan Allen-Zhu 20 80 0 02 Feb 2017
The Power of Normalization: Faster Evasion of Saddle Points Kfir Y. Levy 22 108 0 15 Nov 2016
Finding Approximate Local Minima Faster than Gradient Descent Naman Agarwal Zeyuan Allen-Zhu Brian Bullins Elad Hazan Tengyu Ma 41 83 0 03 Nov 2016
Stochastic Alternating Direction Method of Multipliers with Variance Reduction for Nonconvex Optimization Feihu Huang Songcan Chen Zhaosong Lu 30 14 0 10 Oct 2016
Stochastic Quasi-Newton Methods for Nonconvex Stochastic Optimization Tianlin Li Shiqian Ma D. Goldfarb Wei Liu 24 177 0 05 Jul 2016
Guaranteed Non-convex Optimization: Submodular Maximization over Continuous Domains Yatao Bian Baharan Mirzasoleiman J. M. Buhmann Andreas Krause 26 146 0 17 Jun 2016
Variance-Reduced Proximal Stochastic Gradient Descent for Non-convex Composite optimization Xiyu Yu Dacheng Tao 24 5 0 02 Jun 2016
Riemannian SVRG: Fast Stochastic Optimization on Riemannian Manifolds Hongyi Zhang Sashank J. Reddi S. Sra 36 240 0 23 May 2016
Fast Stochastic Methods for Nonsmooth Nonconvex Optimization Sashank J. Reddi S. Sra Barnabás Póczós Alex Smola 23 54 0 23 May 2016
Barzilai-Borwein Step Size for Stochastic Gradient Descent Conghui Tan Shiqian Ma Yuhong Dai Yuqiu Qian 40 182 0 13 May 2016
Unified Convergence Analysis of Stochastic Momentum Methods for Convex and Non-convex Optimization Tianbao Yang Qihang Lin Zhe Li 9 122 0 12 Apr 2016
Katyusha: The First Direct Acceleration of Stochastic Gradient Methods Zeyuan Allen-Zhu ODL 15 577 0 18 Mar 2016
On the Online Frank-Wolfe Algorithms for Convex and Non-convex Optimizations Jean Lafond Hoi-To Wai Eric Moulines 45 32 0 05 Oct 2015
Improved SVRG for Non-Strongly-Convex or Sum-of-Non-Convex Objectives Zeyuan Allen-Zhu Yang Yuan 29 195 0 05 Jun 2015
A Proximal Stochastic Gradient Method with Progressive Variance Reduction Lin Xiao Tong Zhang ODL 93 737 0 19 Mar 2014
Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning Julien Mairal 79 317 0 18 Feb 2014