LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning

25 May 2018

Tianyi Chen

G. Giannakis

Tao Sun

W. Yin

ArXiv PDF HTML

Papers citing "LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning"

50 / 62 papers shown

Title
A Mirror Descent-Based Algorithm for Corruption-Tolerant Distributed Gradient Descent Shuche Wang Vincent Y. F. Tan FedML OOD 47 1 0 19 Jul 2024
FedEx: Expediting Federated Learning over Heterogeneous Mobile Devices by Overlapping and Participant Selection Jiaxiang Geng Boyu Li Xiaoqi Qin Yixuan Li Liang Li Yanzhao Hou Miao Pan FedML 38 0 0 01 Jul 2024
Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework Siyuan Yu Wei Chen H. V. Poor 32 0 0 17 Jun 2024
Distributed Event-Based Learning via ADMM Güner Dilsad Er Sebastian Trimpe Michael Muehlebach FedML 44 2 0 17 May 2024
Version age-based client scheduling policy for federated learning Xinyi Hu Nikolaos Pappas Howard H. Yang 28 3 0 08 Feb 2024
Rendering Wireless Environments Useful for Gradient Estimators: A Zero-Order Stochastic Federated Learning Method Elissa Mhanna Mohamad Assaad 41 1 0 30 Jan 2024
Budgeted Online Model Selection and Fine-Tuning via Federated Learning P. M. Ghari Yanning Shen FedML 46 1 0 19 Jan 2024
EcoLearn: Optimizing the Carbon Footprint of Federated Learning Talha Mehboob Noman Bashir Jesus Omana Iglesias Michael Zink David E. Irwin 20 0 0 27 Oct 2023
FedDIP: Federated Learning with Extreme Dynamic Pruning and Incremental Regularization Qianyu Long Christos Anagnostopoulos S. P. Parambath Daning Bi AI4CE FedML 23 2 0 13 Sep 2023
Revolutionizing Wireless Networks with Federated Learning: A Comprehensive Review Sajjad Emdadi Mahdimahalleh AI4CE 30 0 0 01 Aug 2023
Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression Yutong He Xinmeng Huang Yiming Chen W. Yin Kun Yuan 28 7 0 12 May 2023
Clustered Federated Learning based on Nonconvex Pairwise Fusion Xue Yu Ziyi Liu Wu Wang Yifan Sun FedML 32 7 0 08 Nov 2022
Adaptive Compression for Communication-Efficient Distributed Training Maksim Makarenko Elnur Gasanov Rustem Islamov Abdurakhmon Sadiev Peter Richtárik 31 12 0 31 Oct 2022
Blind Asynchronous Over-the-Air Federated Edge Learning Saeed Razavikia Jaume Anguera Peris J. M. B. D. Silva Carlo Fischione FedML 19 11 0 31 Oct 2022
A Snapshot of the Frontiers of Client Selection in Federated Learning Gergely Németh M. Lozano Novi Quadrianto Nuria Oliver FedML 102 14 0 27 Sep 2022
Fast Heterogeneous Federated Learning with Hybrid Client Selection Guangyuan Shen D. Gao Duanxiao Song Libin Yang Xukai Zhou Shirui Pan W. Lou Fang Zhou FedML 34 12 0 10 Aug 2022
QC-ODKLA: Quantized and Communication-Censored Online Decentralized Kernel Learning via Linearized ADMM Ping Xu Yue Wang Xiang Chen Zhi Tian 18 2 0 04 Aug 2022
Communication-efficient Distributed Newton-like Optimization with Gradients and M-estimators Ziyan Yin 32 0 0 13 Jul 2022
Lazy Queries Can Reduce Variance in Zeroth-order Optimization Quan-Wu Xiao Qing Ling Tianyi Chen 35 0 0 14 Jun 2022
Matching Pursuit Based Scheduling for Over-the-Air Federated Learning Ali Bereyhi Adela Vagollari S. Asaad R. Muller W. Gerstacker H. Vincent Poor 23 6 0 14 Jun 2022
Event-triggered Approximate Byzantine Consensus with Multi-hop Communication Liwei Yuan H. Ishii AAML 16 14 0 19 Apr 2022
FedCau: A Proactive Stop Policy for Communication and Computation Efficient Federated Learning Afsaneh Mahmoudi H. S. Ghadikolaei José Hélio da Cruz Júnior Carlo Fischione 24 9 0 16 Apr 2022
Distributed Riemannian Optimization with Lazy Communication for Collaborative Geometric Estimation Yulun Tian Amrit Singh Bedi Alec Koppel Miguel Calvo-Fullana David M. Rosen Jonathan P. How 22 5 0 02 Mar 2022
SHED: A Newton-type algorithm for federated learning based on incremental Hessian eigenvector sharing Nicolò Dal Fabbro S. Dey M. Rossi Luca Schenato FedML 29 14 0 11 Feb 2022
Distributed Learning With Sparsified Gradient Differences Yicheng Chen Rick S. Blum Martin Takáč Brian M. Sadler 23 15 0 05 Feb 2022
Adaptive Worker Grouping For Communication-Efficient and Straggler-Tolerant Distributed SGD Feng Zhu Jingjing Zhang Osvaldo Simeone Xin Eric Wang 19 0 0 12 Jan 2022
Federated Reinforcement Learning at the Edge Konstantinos Gatsis FedML 21 5 0 11 Dec 2021
Communication-Efficient Distributed Learning via Sparse and Adaptive Stochastic Gradient Xiaoge Deng Dongsheng Li Tao Sun Xicheng Lu FedML 23 0 0 08 Dec 2021
Exponential Graph is Provably Efficient for Decentralized Deep Training Bicheng Ying Kun Yuan Yiming Chen Hanbin Hu Pan Pan W. Yin FedML 39 83 0 26 Oct 2021
Federated Learning over Wireless IoT Networks with Optimized Communication and Resources Student Member Ieee Hao Chen Shaocheng Huang Deyou Zhang Ming Xiao Fellow Ieee Mikael Skoglund L. F. I. H. Vincent Poor 25 94 0 22 Oct 2021
BEV-SGD: Best Effort Voting SGD for Analog Aggregation Based Federated Learning against Byzantine Attackers Xin-Yue Fan Yue Wang Yan Huo Zhi Tian FedML 22 23 0 18 Oct 2021
Learning, Computing, and Trustworthiness in Intelligent IoT Environments: Performance-Energy Tradeoffs B. Soret L. Nguyen J. Seeger Arne Bröring Chaouki Ben Issaid S. Samarakoon Anis El Gabli V. Kulkarni M. Bennis P. Popovski 25 13 0 04 Oct 2021
Accelerated Gradient Descent Learning over Multiple Access Fading Channels Raz Paul Yuval Friedman Kobi Cohen 22 30 0 26 Jul 2021
Joint Client Scheduling and Resource Allocation under Channel Uncertainty in Federated Learning Madhusanka Manimel Wadu S. Samarakoon M. Bennis 18 51 0 12 Jun 2021
Decentralized Federated Averaging Tao Sun Dongsheng Li Bao Wang FedML 40 207 0 23 Apr 2021
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges Mingzhe Chen Deniz Gündüz Kaibin Huang Walid Saad M. Bennis Aneta Vulgarakis Feljan H. Vincent Poor 35 401 0 05 Apr 2021
Bandwidth Allocation for Multiple Federated Learning Services in Wireless Edge Networks Jie Xu Heqiang Wang Lixing Chen FedML 56 43 0 10 Jan 2021
On the Benefits of Multiple Gossip Steps in Communication-Constrained Decentralized Optimization Abolfazl Hashemi Anish Acharya Rudrajit Das H. Vikalo Sujay Sanghavi Inderjit Dhillon 12 7 0 20 Nov 2020
FederBoost: Private Federated Learning for GBDT Zhihua Tian Rui Zhang Xiaoyang Hou Jian-wei Liu K. Ren Jian Liu Kui Ren FedML AI4CE 47 66 0 05 Nov 2020
Communication Efficient Distributed Learning with Censored, Quantized, and Generalized Group ADMM Chaouki Ben Issaid Anis Elgabli Jihong Park M. Bennis Mérouane Debbah FedML 31 13 0 14 Sep 2020
Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications Jihong Park S. Samarakoon Anis Elgabli Joongheon Kim M. Bennis Seong-Lyun Kim Mérouane Debbah 34 161 0 06 Aug 2020
Multi-Armed Bandit Based Client Scheduling for Federated Learning Wenchao Xia Tony Q. S. Quek Kun Guo Wanli Wen Howard H. Yang Hongbo Zhu FedML 45 218 0 05 Jul 2020
XOR Mixup: Privacy-Preserving Data Augmentation for One-Shot Federated Learning Myungjae Shin Chihoon Hwang Joongheon Kim Jihong Park M. Bennis Seong-Lyun Kim FedML 22 108 0 09 Jun 2020
FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data Xinwei Zhang Mingyi Hong S. Dhople W. Yin Yang Liu FedML 21 227 0 22 May 2020
Joint Parameter-and-Bandwidth Allocation for Improving the Efficiency of Partitioned Edge Learning Dingzhu Wen M. Bennis Kaibin Huang 29 48 0 10 Mar 2020
Communication optimization strategies for distributed deep neural network training: A survey Shuo Ouyang Dezun Dong Yemao Xu Liquan Xiao 22 12 0 06 Mar 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 17 326 0 22 Feb 2020
COKE: Communication-Censored Decentralized Kernel Learning Ping Xu Yue Wang Xiang Chen Z. Tian 13 20 0 28 Jan 2020
Intermittent Pulling with Local Compensation for Communication-Efficient Federated Learning Haozhao Wang Zhihao Qu Song Guo Xin Gao Ruixuan Li Baoliu Ye FedML 6 8 0 22 Jan 2020
Convergence Time Optimization for Federated Learning over Wireless Networks Mingzhe Chen H. Vincent Poor Walid Saad Shuguang Cui 20 295 0 22 Jan 2020