v1v2v3v4 (latest)

On Nonconvex Decentralized Gradient Descent

20 August 2016

Papers citing "On Nonconvex Decentralized Gradient Descent"

42 / 42 papers shown

Title
Scalable Distributed Optimization of Multi-Dimensional Functions Despite Byzantine Adversaries K. Kuwaranancharoen Lei Xin S. Sundaram 71 5 0 11 Mar 2024
Asynchronous Distributed Optimization with Delay-free Parameters Xuyang Wu Changxin Liu Sindri Magnússon Mikael Johansson 30 1 0 11 Dec 2023
Decentralized Riemannian Conjugate Gradient Method on the Stiefel Manifold Jun Chen Haishan Ye Mengmeng Wang Tianxin Huang Guangwen Dai Ivor W.Tsang Yang Liu 55 13 0 21 Aug 2023
A One-Sample Decentralized Proximal Algorithm for Non-Convex Stochastic Composite Optimization Tesi Xiao Xuxing Chen Krishnakumar Balasubramanian Saeed Ghadimi 94 10 0 20 Feb 2023
Decentralized Nonconvex Optimization with Guaranteed Privacy and Accuracy Yongqiang Wang Tamer Basar 79 22 0 14 Dec 2022
Distributed Online Non-convex Optimization with Composite Regret Zhanhong Jiang Aditya Balu Xian Yeow Lee Young M. Lee Chinmay Hegde Soumik Sarkar 97 4 0 21 Sep 2022
DR-DSGD: A Distributionally Robust Decentralized Learning Algorithm over Graphs Chaouki Ben Issaid Anis Elgabli M. Bennis FedML OOD 90 5 0 29 Aug 2022
A Variance-Reduced Stochastic Gradient Tracking Algorithm for Decentralized Optimization with Orthogonality Constraints Lei Wang Xin Liu 121 8 0 29 Aug 2022
NET-FLEET: Achieving Linear Convergence Speedup for Fully Decentralized Federated Learning with Heterogeneous Data Xin Zhang Minghong Fang Zhuqing Liu Haibo Yang Jia-Wei Liu Zhengyuan Zhu FedML 66 14 0 17 Aug 2022
Semi-Decentralized Federated Learning with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 78 32 0 23 May 2022
Robust Federated Learning with Connectivity Failures: A Semi-Decentralized Framework with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 120 9 0 24 Feb 2022
Distributed Random Reshuffling over Networks Kun-Yen Huang Xiao Li Andre Milzarek Shi Pu Junwen Qiu 94 11 0 31 Dec 2021
Collaborative Learning over Wireless Networks: An Introductory Overview Emre Ozfatura Deniz Gunduz H. Vincent Poor 73 12 0 07 Dec 2021
Distributed Sparse Regression via Penalization Yao Ji G. Scutari Ying Sun Harsha Honnappa 61 6 0 12 Nov 2021
Learning to Coordinate in Multi-Agent Systems: A Coordinated Actor-Critic Algorithm and Finite-Time Guarantees Siliang Zeng Tianyi Chen Alfredo García Mingyi Hong 92 11 0 11 Oct 2021
An Empirical Study on Compressed Decentralized Stochastic Gradient Algorithms with Overparameterized Models A. Rao Hoi-To Wai 26 0 0 09 Oct 2021
Distributed stochastic gradient tracking algorithm with variance reduction for non-convex optimization Xia Jiang Xianlin Zeng Jian Sun Jie Chen 61 14 0 28 Jun 2021
GT-STORM: Taming Sample, Communication, and Memory Complexities in Decentralized Non-Convex Learning Xin Zhang Jia Liu Zhengyuan Zhu Elizabeth S. Bentley 84 14 0 04 May 2021
Decentralized Federated Averaging Tao Sun Dongsheng Li Bao Wang FedML 88 217 0 23 Apr 2021
1-Bit Compressive Sensing for Efficient Federated Learning Over the Air Xin-Yue Fan Yue Wang Yan Huo Z. Tian FedML 73 34 0 30 Mar 2021
Distributed Stochastic Consensus Optimization with Momentum for Nonconvex Nonsmooth Problems Zhiguo Wang Jiawei Zhang Tsung-Hui Chang Jian Li Zhi-Quan Luo 71 36 0 10 Nov 2020
A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems Jiawei Zhang Peijun Xiao Ruoyu Sun Zhi-Quan Luo 120 99 0 29 Oct 2020
Distributed Stochastic Nonconvex Optimization and Learning based on Successive Convex Approximation P. Lorenzo Simone Scardapane 53 2 0 30 Apr 2020
Asynchronous Decentralized Learning of a Neural Network Xinyue Liang Alireza M. Javid Mikael Skoglund Saikat Chatterjee 49 8 0 10 Apr 2020
Distributed Learning in the Non-Convex World: From Batch to Streaming Data, and Beyond Tsung-Hui Chang Mingyi Hong Hoi-To Wai Xinwei Zhang Songtao Lu GNN 63 13 0 14 Jan 2020
Private and Communication-Efficient Edge Learning: A Sparse Differential Gaussian-Masking Distributed SGD Approach Xin Zhang Minghong Fang Jia-Wei Liu Zhengyuan Zhu FedML 73 27 0 12 Jan 2020
A Proximal Linearization-based Decentralized Method for Nonconvex Problems with Nonlinear Constraints Yu Yang G. Hu C. Spanos 15 4 0 03 Jan 2020
Communication-Efficient Network-Distributed Optimization with Differential-Coded Compressors Xin Zhang Jia-Wei Liu Zhengyuan Zhu Elizabeth S. Bentley 42 7 0 06 Dec 2019
A Decentralized Proximal Point-type Method for Saddle Point Problems Weijie Liu Aryan Mokhtari Asuman Ozdaglar S. Pattathil Zebang Shen Nenggan Zheng 132 30 0 31 Oct 2019
Improving the Sample and Communication Complexity for Decentralized Non-Convex Optimization: A Joint Gradient Estimation and Tracking Approach Haoran Sun Songtao Lu Mingyi Hong 74 37 0 13 Oct 2019
Distributed Deep Learning with Event-Triggered Communication Jemin George Prudhvi K. Gurram 46 16 0 08 Sep 2019
BRIDGE: Byzantine-resilient Decentralized Gradient Descent Cheng Fang Zhixiong Yang W. Bajwa 80 101 0 21 Aug 2019
Robust and Communication-Efficient Collaborative Learning Amirhossein Reisizadeh Hossein Taheri Aryan Mokhtari Hamed Hassani Ramtin Pedarsani 99 92 0 24 Jul 2019
MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling Jianyu Wang Anit Kumar Sahu Zhouyi Yang Gauri Joshi S. Kar 90 163 0 23 May 2019
Decentralized Online Learning: Take Benefits from Others' Data without Sharing Your Own to Track Global Trend Wendi Wu Zongren Li Yawei Zhao Chenkai Yu P. Zhao Ji Liu FedML 90 17 0 29 Jan 2019
DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization Parvin Nazari Davoud Ataee Tarzanagh George Michailidis ODL 96 68 0 25 Jan 2019
Compressed Distributed Gradient Descent: Communication-Efficient Consensus over Networks Xin Zhang Jia Liu Zhengyuan Zhu Elizabeth S. Bentley 95 27 0 10 Dec 2018
Global Optimality in Distributed Low-rank Matrix Factorization Zhihui Zhu Qiuwei Li Xinshuo Yang Gongguo Tang Michael B. Wakin 38 4 0 07 Nov 2018
Second-order Guarantees of Distributed Gradient Algorithms Amir Daneshmand G. Scutari Vyacheslav Kungurtsev 134 59 0 23 Sep 2018
On Markov Chain Gradient Descent Tao Sun Yuejiao Sun W. Yin BDL 54 102 0 12 Sep 2018
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms Jianyu Wang Gauri Joshi 196 350 0 22 Aug 2018
Collaborative Deep Learning in Fixed Topology Networks Zhanhong Jiang Aditya Balu Chinmay Hegde Soumik Sarkar FedML 71 181 0 23 Jun 2017