LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning

25 May 2018

Tianyi Chen

G. Giannakis

Tao Sun

W. Yin

ArXiv PDF HTML

Papers citing "LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning"

50 / 56 papers shown

Title
A Mirror Descent-Based Algorithm for Corruption-Tolerant Distributed Gradient Descent Shuche Wang Vincent Y. F. Tan FedML OOD 45 1 0 19 Jul 2024
FedEx: Expediting Federated Learning over Heterogeneous Mobile Devices by Overlapping and Participant Selection Jiaxiang Geng Boyu Li Xiaoqi Qin Yixuan Li Liang Li Yanzhao Hou Miao Pan FedML 38 0 0 01 Jul 2024
Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework Siyuan Yu Wei Chen H. V. Poor 26 0 0 17 Jun 2024
Distributed Event-Based Learning via ADMM Güner Dilsad Er Sebastian Trimpe Michael Muehlebach FedML 44 2 0 17 May 2024
Version age-based client scheduling policy for federated learning Xinyi Hu Nikolaos Pappas Howard H. Yang 28 3 0 08 Feb 2024
Rendering Wireless Environments Useful for Gradient Estimators: A Zero-Order Stochastic Federated Learning Method Elissa Mhanna Mohamad Assaad 41 1 0 30 Jan 2024
Budgeted Online Model Selection and Fine-Tuning via Federated Learning P. M. Ghari Yanning Shen FedML 43 1 0 19 Jan 2024
FedDIP: Federated Learning with Extreme Dynamic Pruning and Incremental Regularization Qianyu Long Christos Anagnostopoulos S. P. Parambath Daning Bi AI4CE FedML 11 2 0 13 Sep 2023
Revolutionizing Wireless Networks with Federated Learning: A Comprehensive Review Sajjad Emdadi Mahdimahalleh AI4CE 28 0 0 01 Aug 2023
Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression Yutong He Xinmeng Huang Yiming Chen W. Yin Kun Yuan 28 7 0 12 May 2023
Clustered Federated Learning based on Nonconvex Pairwise Fusion Xue Yu Ziyi Liu Wu Wang Yifan Sun FedML 32 7 0 08 Nov 2022
Adaptive Compression for Communication-Efficient Distributed Training Maksim Makarenko Elnur Gasanov Rustem Islamov Abdurakhmon Sadiev Peter Richtárik 21 12 0 31 Oct 2022
Blind Asynchronous Over-the-Air Federated Edge Learning Saeed Razavikia Jaume Anguera Peris J. M. B. D. Silva Carlo Fischione FedML 16 11 0 31 Oct 2022
Fast Heterogeneous Federated Learning with Hybrid Client Selection Guangyuan Shen D. Gao Duanxiao Song Libin Yang Xukai Zhou Shirui Pan W. Lou Fang Zhou FedML 27 12 0 10 Aug 2022
QC-ODKLA: Quantized and Communication-Censored Online Decentralized Kernel Learning via Linearized ADMM Ping Xu Yue Wang Xiang Chen Zhi Tian 16 2 0 04 Aug 2022
Communication-efficient Distributed Newton-like Optimization with Gradients and M-estimators Ziyan Yin 32 0 0 13 Jul 2022
Lazy Queries Can Reduce Variance in Zeroth-order Optimization Quan-Wu Xiao Qing Ling Tianyi Chen 33 0 0 14 Jun 2022
Event-triggered Approximate Byzantine Consensus with Multi-hop Communication Liwei Yuan H. Ishii AAML 16 14 0 19 Apr 2022
FedCau: A Proactive Stop Policy for Communication and Computation Efficient Federated Learning Afsaneh Mahmoudi H. S. Ghadikolaei José Hélio da Cruz Júnior Carlo Fischione 19 9 0 16 Apr 2022
Distributed Riemannian Optimization with Lazy Communication for Collaborative Geometric Estimation Yulun Tian Amrit Singh Bedi Alec Koppel Miguel Calvo-Fullana David M. Rosen Jonathan P. How 22 5 0 02 Mar 2022
SHED: A Newton-type algorithm for federated learning based on incremental Hessian eigenvector sharing Nicolò Dal Fabbro S. Dey M. Rossi Luca Schenato FedML 29 14 0 11 Feb 2022
Distributed Learning With Sparsified Gradient Differences Yicheng Chen Rick S. Blum Martin Takáč Brian M. Sadler 18 15 0 05 Feb 2022
Adaptive Worker Grouping For Communication-Efficient and Straggler-Tolerant Distributed SGD Feng Zhu Jingjing Zhang Osvaldo Simeone Xin Eric Wang 14 0 0 12 Jan 2022
Federated Reinforcement Learning at the Edge Konstantinos Gatsis FedML 19 5 0 11 Dec 2021
Communication-Efficient Distributed Learning via Sparse and Adaptive Stochastic Gradient Xiaoge Deng Dongsheng Li Tao Sun Xicheng Lu FedML 13 0 0 08 Dec 2021
Exponential Graph is Provably Efficient for Decentralized Deep Training Bicheng Ying Kun Yuan Yiming Chen Hanbin Hu Pan Pan W. Yin FedML 36 83 0 26 Oct 2021
Federated Learning over Wireless IoT Networks with Optimized Communication and Resources Student Member Ieee Hao Chen Shaocheng Huang Deyou Zhang Ming Xiao Fellow Ieee Mikael Skoglund L. F. I. H. Vincent Poor 18 94 0 22 Oct 2021
BEV-SGD: Best Effort Voting SGD for Analog Aggregation Based Federated Learning against Byzantine Attackers Xin-Yue Fan Yue Wang Yan Huo Zhi Tian FedML 17 23 0 18 Oct 2021
Learning, Computing, and Trustworthiness in Intelligent IoT Environments: Performance-Energy Tradeoffs B. Soret L. Nguyen J. Seeger Arne Bröring Chaouki Ben Issaid S. Samarakoon Anis El Gabli V. Kulkarni M. Bennis P. Popovski 25 13 0 04 Oct 2021
Accelerated Gradient Descent Learning over Multiple Access Fading Channels Raz Paul Yuval Friedman Kobi Cohen 22 30 0 26 Jul 2021
Joint Client Scheduling and Resource Allocation under Channel Uncertainty in Federated Learning Madhusanka Manimel Wadu S. Samarakoon M. Bennis 16 51 0 12 Jun 2021
Decentralized Federated Averaging Tao Sun Dongsheng Li Bao Wang FedML 40 206 0 23 Apr 2021
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges Mingzhe Chen Deniz Gündüz Kaibin Huang Walid Saad M. Bennis Aneta Vulgarakis Feljan H. Vincent Poor 32 401 0 05 Apr 2021
Bandwidth Allocation for Multiple Federated Learning Services in Wireless Edge Networks Jie Xu Heqiang Wang Lixing Chen FedML 56 43 0 10 Jan 2021
FederBoost: Private Federated Learning for GBDT Zhihua Tian Rui Zhang Xiaoyang Hou Jian-wei Liu K. Ren Jian Liu Kui Ren FedML AI4CE 39 66 0 05 Nov 2020
Communication Efficient Distributed Learning with Censored, Quantized, and Generalized Group ADMM Chaouki Ben Issaid Anis Elgabli Jihong Park M. Bennis Mérouane Debbah FedML 21 13 0 14 Sep 2020
Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications Jihong Park S. Samarakoon Anis Elgabli Joongheon Kim M. Bennis Seong-Lyun Kim Mérouane Debbah 28 161 0 06 Aug 2020
Multi-Armed Bandit Based Client Scheduling for Federated Learning Wenchao Xia Tony Q. S. Quek Kun Guo Wanli Wen Howard H. Yang Hongbo Zhu FedML 42 218 0 05 Jul 2020
XOR Mixup: Privacy-Preserving Data Augmentation for One-Shot Federated Learning Myungjae Shin Chihoon Hwang Joongheon Kim Jihong Park M. Bennis Seong-Lyun Kim FedML 22 108 0 09 Jun 2020
FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data Xinwei Zhang Mingyi Hong S. Dhople W. Yin Yang Liu FedML 21 227 0 22 May 2020
Joint Parameter-and-Bandwidth Allocation for Improving the Efficiency of Partitioned Edge Learning Dingzhu Wen M. Bennis Kaibin Huang 24 48 0 10 Mar 2020
Communication optimization strategies for distributed deep neural network training: A survey Shuo Ouyang Dezun Dong Yemao Xu Liquan Xiao 22 12 0 06 Mar 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 17 326 0 22 Feb 2020
COKE: Communication-Censored Decentralized Kernel Learning Ping Xu Yue Wang Xiang Chen Z. Tian 11 20 0 28 Jan 2020
Convergence Time Optimization for Federated Learning over Wireless Networks Mingzhe Chen H. Vincent Poor Walid Saad Shuguang Cui 17 295 0 22 Jan 2020
One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis Guangxu Zhu Yuqing Du Deniz Gunduz Kaibin Huang 31 308 0 16 Jan 2020
Federated Variance-Reduced Stochastic Gradient Descent with Robustness to Byzantine Attacks Zhaoxian Wu Qing Ling Tianyi Chen G. Giannakis FedML AAML 22 181 0 29 Dec 2019
Q-GADMM: Quantized Group ADMM for Communication Efficient Decentralized Machine Learning Anis Elgabli Jihong Park Amrit Singh Bedi Chaouki Ben Issaid M. Bennis Vaneet Aggarwal 16 67 0 23 Oct 2019
General Proximal Incremental Aggregated Gradient Algorithms: Better and Novel Results under General Scheme Tao Sun Yuejiao Sun Dongsheng Li Qing Liao 30 16 0 11 Oct 2019
High-Dimensional Stochastic Gradient Quantization for Communication-Efficient Edge Learning Yuqing Du Sheng Yang Kaibin Huang 24 99 0 09 Oct 2019