A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization

12 February 2021

Papers citing "A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization"

19 / 19 papers shown

Title
Faster Adaptive Decentralized Learning Algorithms Feihu Huang Jianyu Zhao 48 0 0 19 Aug 2024
The Effectiveness of Local Updates for Decentralized Learning under Data Heterogeneity Tongle Wu Ying Sun 44 0 0 23 Mar 2024
Decentralized Gradient-Free Methods for Stochastic Non-Smooth Non-Convex Optimization Zhenwei Lin Jingfan Xia Qi Deng Luo Luo 31 3 0 18 Oct 2023
Serverless Federated AUPRC Optimization for Multi-Party Collaborative Imbalanced Data Mining Xidong Wu Zhengmian Hu Jian Pei Heng Huang 35 12 0 06 Aug 2023
Decentralized Local Updates with Dual-Slow Estimation and Momentum-based Variance-Reduction for Non-Convex Optimization Kangyang Luo Kunkun Zhang Sheng Zhang Xiang Li Ming Gao 27 2 0 17 Jul 2023
Variance-reduced accelerated methods for decentralized stochastic double-regularized nonconvex strongly-concave minimax problems Gabriel Mancino-Ball Yangyang Xu 20 8 0 14 Jul 2023
Distributed Random Reshuffling Methods with Improved Convergence Kun-Yen Huang Linli Zhou Shi Pu 24 4 0 21 Jun 2023
Near-Optimal Decentralized Momentum Method for Nonconvex-PL Minimax Problems Feihu Huang Songcan Chen 15 5 0 21 Apr 2023
A Unified Momentum-based Paradigm of Decentralized SGD for Non-Convex Models and Heterogeneous Data Haizhou Du Chengdong Ni 22 1 0 01 Mar 2023
GradMA: A Gradient-Memory-based Accelerated Federated Learning with Alleviated Catastrophic Forgetting Kangyang Luo Xiang Li Yunshi Lan Ming Gao FedML 36 33 0 28 Feb 2023
DIAMOND: Taming Sample and Communication Complexities in Decentralized Bilevel Optimization Pei-Yuan Qiu Yining Li Zhuqing Liu Prashant Khanduri Jia Liu Ness B. Shroff Elizabeth S. Bentley K. Turck 19 4 0 05 Dec 2022
On the Convergence of Distributed Stochastic Bilevel Optimization Algorithms over a Network Hongchang Gao Bin Gu My T. Thai 35 14 0 30 Jun 2022
Distributed saddle point problems for strongly concave-convex functions Muhammad I. Qureshi U. Khan 39 12 0 11 Feb 2022
DoCoM: Compressed Decentralized Optimization with Near-Optimal Sample Complexity Chung-Yiu Yau Hoi-To Wai 88 6 0 01 Feb 2022
Variance-Reduced Stochastic Quasi-Newton Methods for Decentralized Learning: Part I Jiaojiao Zhang Huikang Liu Anthony Man-Cho So Qing Ling 24 14 0 19 Jan 2022
MDPGT: Momentum-based Decentralized Policy Gradient Tracking Zhanhong Jiang Xian Yeow Lee Sin Yong Tan Kai Liang Tan Aditya Balu Young M. Lee C. Hegde S. Sarkar 16 7 0 06 Dec 2021
A Unified and Refined Convergence Analysis for Non-Convex Decentralized Learning Sulaiman A. Alghunaim Kun Yuan 40 57 0 19 Oct 2021
Distributed stochastic gradient tracking algorithm with variance reduction for non-convex optimization Xia Jiang Xianlin Zeng Jian Sun Jie Chen 18 14 0 28 Jun 2021
Optimal Complexity in Decentralized Training Yucheng Lu Christopher De Sa 38 72 0 15 Jun 2020