Distributed Stochastic Non-Convex Optimization: Momentum-Based Variance
Reduction

Distributed Stochastic Non-Convex Optimization: Momentum-Based Variance Reduction

1 May 2020

Prashant Khanduri

Swatantra Kafle

Saikiran Bulusu

Papers citing "Distributed Stochastic Non-Convex Optimization: Momentum-Based Variance Reduction"

14 / 14 papers shown

Title
Distributed Learning in the Non-Convex World: From Batch to Streaming Data, and Beyond Tsung-Hui Chang Mingyi Hong Hoi-To Wai Xinwei Zhang Songtao Lu GNN 50 13 0 14 Jan 2020
Parallel Restarted SPIDER -- Communication Efficient Distributed Nonconvex Optimization with Optimal Computation Complexity Pranay Sharma Swatantra Kafle Prashant Khanduri Saikiran Bulusu K. Rajawat P. Varshney FedML 64 17 0 12 Dec 2019
Momentum-Based Variance Reduction in Non-Convex SGD Ashok Cutkosky Francesco Orabona ODL 78 406 0 24 May 2019
Hybrid Stochastic Gradient Descent Algorithms for Stochastic Nonconvex Optimization Quoc Tran-Dinh Nhan H. Pham Dzung Phan Lam M. Nguyen 59 56 0 15 May 2019
Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview Yuejie Chi Yue M. Lu Yuxin Chen 58 425 0 25 Sep 2018
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms Jianyu Wang Gauri Joshi 160 349 0 22 Aug 2018
Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep Learning Hao Yu Sen Yang Shenghuo Zhu MoMe FedML 73 605 0 17 Jul 2018
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator Cong Fang C. J. Li Zhouchen Lin Tong Zhang 87 577 0 04 Jul 2018
On the Convergence of Stochastic Gradient Descent with Adaptive Stepsizes Xiaoyun Li Francesco Orabona 67 295 0 21 May 2018
Federated Optimization: Distributed Machine Learning for On-Device Intelligence Jakub Konecný H. B. McMahan Daniel Ramage Peter Richtárik FedML 126 1,897 0 08 Oct 2016
Robust PCA via Nonconvex Rank Approximation Zhao Kang Chong Peng Q. Cheng 49 161 0 17 Nov 2015
Non-convex Robust PCA Praneeth Netrapalli U. Niranjan Sujay Sanghavi Anima Anandkumar Prateek Jain 84 286 0 28 Oct 2014
Protecting Privacy through Distributed Computation in Multi-agent Decision Making Thomas Léauté Boi Faltings 35 63 0 04 Feb 2014
Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming Saeed Ghadimi Guanghui Lan ODL 120 1,549 0 22 Sep 2013

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.