Communication-Efficient Algorithms for Decentralized and Stochastic Optimization

14 January 2017

Papers citing "Communication-Efficient Algorithms for Decentralized and Stochastic Optimization"

43 / 43 papers shown

Title
From Interpretation to Correction: A Decentralized Optimization Framework for Exact Convergence in Federated Learning Bicheng Ying Zhe Li Haibo Yang FedML 70 0 0 25 Mar 2025
Federated Multi-Level Optimization over Decentralized Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang AI4CE 28 0 0 10 Oct 2023
Adaptive Consensus: A network pruning approach for decentralized optimization S. Shah A. Berahas Raghu Bollapragada 22 2 0 06 Sep 2023
Revolutionizing Wireless Networks with Federated Learning: A Comprehensive Review Sajjad Emdadi Mahdimahalleh AI4CE 35 0 0 01 Aug 2023
Blockchain-Based Federated Learning: Incentivizing Data Sharing and Penalizing Dishonest Behavior Amir Jaberzadeh A. Shrestha F. Khan Mohammed Afaan Shaikh Bhargav Dave Jason Geng FedML 27 3 0 19 Jul 2023
CoDeC: Communication-Efficient Decentralized Continual Learning Sakshi Choudhary Sai Aparna Aketi Gobinda Saha Kaushik Roy CLL 50 3 0 27 Mar 2023
Distributed Optimization Methods for Multi-Robot Systems: Part II -- A Survey O. Shorinwa Trevor Halsted Javier Yu Mac Schwager 24 18 0 26 Jan 2023
CEDAS: A Compressed Decentralized Stochastic Gradient Method with Improved Convergence Kun-Yen Huang Shin-Yi Pu 35 9 0 14 Jan 2023
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming Parvin Nazari Ahmad Mousavi Davoud Ataee Tarzanagh George Michailidis 28 4 0 08 Nov 2022
Decentralized Gossip-Based Stochastic Bilevel Optimization over Communication Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang 40 42 0 22 Jun 2022
Confederated Learning: Federated Learning with Decentralized Edge Servers Bin Wang Jun Fang Hongbin Li Xiaojun Yuan Qing Ling FedML 26 23 0 30 May 2022
Local Stochastic Factored Gradient Descent for Distributed Quantum State Tomography J. Kim Taha Toghani César A. Uribe Anastasios Kyrillidis 32 3 0 22 Mar 2022
Decentralized Multi-Task Stochastic Optimization With Compressed Communications Navjot Singh Xuanyu Cao Suhas Diggavi Tamer Basar 18 9 0 23 Dec 2021
Convergence Rates of Two-Time-Scale Gradient Descent-Ascent Dynamics for Solving Nonconvex Min-Max Problems Thinh T. Doan 20 15 0 17 Dec 2021
Federated Learning over Wireless IoT Networks with Optimized Communication and Resources Student Member Ieee Hao Chen Shaocheng Huang Deyou Zhang Ming Xiao Fellow Ieee Mikael Skoglund L. F. I. H. Vincent Poor 25 94 0 22 Oct 2021
Decentralized Local Stochastic Extra-Gradient for Variational Inequalities Aleksandr Beznosikov Pavel Dvurechensky Anastasia Koloskova V. Samokhin Sebastian U. Stich Alexander Gasnikov 32 43 0 15 Jun 2021
Decentralized Federated Averaging Tao Sun Dongsheng Li Bao Wang FedML 48 207 0 23 Apr 2021
A Survey of Distributed Optimization Methods for Multi-Robot Systems Trevor Halsted O. Shorinwa Javier Yu Mac Schwager 25 39 0 23 Mar 2021
Distributed Bootstrap for Simultaneous Inference Under High Dimensionality Yang Yu Shih-Kang Chao Guang Cheng FedML 35 10 0 19 Feb 2021
Decentralized Distributed Optimization for Saddle Point Problems Alexander Rogozin Alexander Beznosikov D. Dvinskikh D. Kovalev Pavel Dvurechensky Alexander Gasnikov 28 27 0 15 Feb 2021
Newton Method over Networks is Fast up to the Statistical Precision Amir Daneshmand G. Scutari Pavel Dvurechensky Alexander Gasnikov 30 22 0 12 Feb 2021
A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! D. Kovalev Anastasia Koloskova Martin Jaggi Peter Richtárik Sebastian U. Stich 23 73 0 03 Nov 2020
Lower Bounds and Optimal Algorithms for Personalized Federated Learning Filip Hanzely Slavomír Hanzely Samuel Horváth Peter Richtárik FedML 50 186 0 05 Oct 2020
Optimization for Supervised Machine Learning: Randomized Algorithms for Data and Parameters Filip Hanzely 34 0 0 26 Aug 2020
Incremental Without Replacement Sampling in Nonconvex Optimization Edouard Pauwels 38 5 0 15 Jul 2020
Gradient tracking and variance reduction for decentralized optimization and machine learning Ran Xin S. Kar U. Khan 19 10 0 13 Feb 2020
Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks Jinming Xu Ye Tian Ying Sun G. Scutari 24 37 0 23 Oct 2019
Q-GADMM: Quantized Group ADMM for Communication Efficient Decentralized Machine Learning Anis Elgabli Jihong Park Amrit Singh Bedi Chaouki Ben Issaid M. Bennis Vaneet Aggarwal 24 67 0 23 Oct 2019
Communication-Efficient Local Decentralized SGD Methods Xiang Li Wenhao Yang Shusen Wang Zhihua Zhang 30 53 0 21 Oct 2019
Robust Distributed Accelerated Stochastic Gradient Methods for Multi-Agent Networks Alireza Fallah Mert Gurbuzbalaban Asuman Ozdaglar Umut Simsekli Lingjiong Zhu 29 28 0 19 Oct 2019
Regularized Diffusion Adaptation via Conjugate Smoothing Stefan Vlaski L. Vandenberghe Ali H. Sayed 15 6 0 20 Sep 2019
Communication-Censored Linearized ADMM for Decentralized Consensus Optimization Weiyu Li Yaohua Liu Z. Tian Qing Ling 14 22 0 15 Sep 2019
Stochastic First-order Methods for Convex and Nonconvex Functional Constrained Optimization Digvijay Boob Qi Deng Guanghui Lan 44 93 0 07 Aug 2019
Asymptotic Network Independence in Distributed Stochastic Optimization for Machine Learning Shi Pu Alexander Olshevsky I. Paschalidis 28 41 0 28 Jun 2019
Communication-Efficient Accurate Statistical Estimation Jianqing Fan Yongyi Guo Kaizheng Wang 19 110 0 12 Jun 2019
Asynchronous decentralized accelerated stochastic gradient descent Guanghui Lan Yi Zhou 13 15 0 24 Sep 2018
Decentralize and Randomize: Faster Algorithm for Wasserstein Barycenters Pavel Dvurechensky D. Dvinskikh Alexander Gasnikov César A. Uribe Angelia Nedić 17 104 0 11 Jun 2018
Distributed Stochastic Gradient Tracking Methods Shi Pu A. Nedić 26 287 0 25 May 2018
LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning Tianyi Chen G. Giannakis Tao Sun W. Yin 31 297 0 25 May 2018
A Distributed Stochastic Gradient Tracking Method Shi Pu A. Nedić 29 60 0 21 Mar 2018
D $^2$ : Decentralized Training over Decentralized Data Hanlin Tang Xiangru Lian Ming Yan Ce Zhang Ji Liu 20 348 0 19 Mar 2018
Collaborative Deep Learning in Fixed Topology Networks Zhanhong Jiang Aditya Balu C. Hegde S. Sarkar FedML 18 179 0 23 Jun 2017
A Fast Distributed Proximal-Gradient Method Annie I. Chen Asuman Ozdaglar 68 146 0 08 Oct 2012