Natasha: Faster Non-Convex Stochastic Optimization Via Strongly Non-Convex Parameter

2 February 2017

Papers citing "Natasha: Faster Non-Convex Stochastic Optimization Via Strongly Non-Convex Parameter"

15 / 15 papers shown

Title
Damped Proximal Augmented Lagrangian Method for weakly-Convex Problems with Convex Constraints Hari Dahal Wei Liu Yangyang Xu 47 5 0 15 Nov 2023
Zeroth-Order Alternating Gradient Descent Ascent Algorithms for a Class of Nonconvex-Nonconcave Minimax Problems Zi Xu Ziqi Wang Junlin Wang Y. Dai 21 11 0 24 Nov 2022
Adaptive Stochastic Variance Reduction for Non-convex Finite-Sum Minimization Ali Kavis Stratis Skoulakis Kimon Antonakopoulos L. Dadi V. Cevher 24 15 0 03 Nov 2022
Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updates Fangcheng Fu Xupeng Miao Jiawei Jiang Huanran Xue Bin Cui FedML 32 21 0 29 Jul 2022
A General Family of Stochastic Proximal Gradient Methods for Deep Learning Jihun Yun A. Lozano Eunho Yang 20 12 0 15 Jul 2020
Ordered SGD: A New Stochastic Optimization Framework for Empirical Risk Minimization Kenji Kawaguchi Haihao Lu ODL 22 62 0 09 Jul 2019
Stochastic Optimization for DC Functions and Non-smooth Non-convex Regularizers with Non-asymptotic Convergence Yi Tian Xu Qi Qi Qihang Lin R. L. Jin Tianbao Yang 37 41 0 28 Nov 2018
Continuous-time Models for Stochastic Optimization Algorithms Antonio Orvieto Aurelien Lucchi 19 31 0 05 Oct 2018
Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learning Hassan Rafique Mingrui Liu Qihang Lin Tianbao Yang 15 107 0 04 Oct 2018
AdaGrad stepsizes: Sharp convergence over nonconvex landscapes Rachel A. Ward Xiaoxia Wu Léon Bottou ODL 27 359 0 05 Jun 2018
signSGD: Compressed Optimisation for Non-Convex Problems Jeremy Bernstein Yu-Xiang Wang Kamyar Azizzadenesheli Anima Anandkumar FedML ODL 44 1,020 0 13 Feb 2018
Katyusha X: Practical Momentum Method for Stochastic Sum-of-Nonconvex Optimization Zeyuan Allen-Zhu ODL 44 52 0 12 Feb 2018
Stochastic Nonconvex Optimization with Large Minibatches Weiran Wang Nathan Srebro 36 26 0 25 Sep 2017
Natasha 2: Faster Non-Convex Optimization Than SGD Zeyuan Allen-Zhu ODL 28 245 0 29 Aug 2017
Stochastic Recursive Gradient Algorithm for Nonconvex Optimization Lam M. Nguyen Jie Liu K. Scheinberg Martin Takáč 11 94 0 20 May 2017