Natasha: Faster Non-Convex Stochastic Optimization Via Strongly Non-Convex Parameter

2 February 2017

Papers citing "Natasha: Faster Non-Convex Stochastic Optimization Via Strongly Non-Convex Parameter"

20 / 20 papers shown

Title
Damped Proximal Augmented Lagrangian Method for weakly-Convex Problems with Convex Constraints Hari Dahal Wei Liu Yangyang Xu 47 5 0 15 Nov 2023
Zeroth-Order Alternating Gradient Descent Ascent Algorithms for a Class of Nonconvex-Nonconcave Minimax Problems Zi Xu Ziqi Wang Junlin Wang Y. Dai 26 11 0 24 Nov 2022
Adaptive Stochastic Variance Reduction for Non-convex Finite-Sum Minimization Ali Kavis Stratis Skoulakis Kimon Antonakopoulos L. Dadi V. Cevher 24 15 0 03 Nov 2022
Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updates Fangcheng Fu Xupeng Miao Jiawei Jiang Huanran Xue Bin Cui FedML 32 21 0 29 Jul 2022
Variance-Reduced Methods for Machine Learning Robert Mansel Gower Mark W. Schmidt Francis R. Bach Peter Richtárik 19 111 0 02 Oct 2020
A General Family of Stochastic Proximal Gradient Methods for Deep Learning Jihun Yun A. Lozano Eunho Yang 20 12 0 15 Jul 2020
Ordered SGD: A New Stochastic Optimization Framework for Empirical Risk Minimization Kenji Kawaguchi Haihao Lu ODL 22 62 0 09 Jul 2019
A Hybrid Stochastic Optimization Framework for Stochastic Composite Nonconvex Optimization Quoc Tran-Dinh Nhan H. Pham T. Dzung Lam M. Nguyen 27 49 0 08 Jul 2019
Solving Empirical Risk Minimization in the Current Matrix Multiplication Time Y. Lee Zhao Song Qiuyi Zhang 19 115 0 11 May 2019
Stochastic Optimization for DC Functions and Non-smooth Non-convex Regularizers with Non-asymptotic Convergence Yi Tian Xu Qi Qi Qihang Lin Rong Jin Tianbao Yang 37 41 0 28 Nov 2018
Continuous-time Models for Stochastic Optimization Algorithms Antonio Orvieto Aurelien Lucchi 19 31 0 05 Oct 2018
Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learning Hassan Rafique Mingrui Liu Qihang Lin Tianbao Yang 15 107 0 04 Oct 2018
AdaGrad stepsizes: Sharp convergence over nonconvex landscapes Rachel A. Ward Xiaoxia Wu Léon Bottou ODL 27 361 0 05 Jun 2018
Multichannel Sparse Blind Deconvolution on the Sphere Yanjun Li Y. Bresler 9 16 0 26 May 2018
Local Optimality and Generalization Guarantees for the Langevin Algorithm via Empirical Metastability Belinda Tzen Tengyuan Liang Maxim Raginsky 11 32 0 18 Feb 2018
signSGD: Compressed Optimisation for Non-Convex Problems Jeremy Bernstein Yu-Xiang Wang Kamyar Azizzadenesheli Anima Anandkumar FedML ODL 44 1,021 0 13 Feb 2018
Katyusha X: Practical Momentum Method for Stochastic Sum-of-Nonconvex Optimization Zeyuan Allen-Zhu ODL 44 52 0 12 Feb 2018
Stochastic Nonconvex Optimization with Large Minibatches Weiran Wang Nathan Srebro 36 26 0 25 Sep 2017
Natasha 2: Faster Non-Convex Optimization Than SGD Zeyuan Allen-Zhu ODL 28 245 0 29 Aug 2017
Stochastic Recursive Gradient Algorithm for Nonconvex Optimization Lam M. Nguyen Jie Liu K. Scheinberg Martin Takáč 11 94 0 20 May 2017