Federated Learning with Compression: Unified Analysis and Sharp Guarantees

2 July 2020

Farzin Haddadpour

Mohammad Mahdi Kamani

Papers citing "Federated Learning with Compression: Unified Analysis and Sharp Guarantees"

50 / 152 papers shown

Title
Learning Distributionally Robust Models at Scale via Composite Optimization Farzin Haddadpour Mohammad Mahdi Kamani M. Mahdavi Amin Karbasi OOD 10 5 0 17 Mar 2022
Privacy-Aware Compression for Federated Data Analysis Kamalika Chaudhuri Chuan Guo Michael G. Rabbat FedML 30 27 0 15 Mar 2022
Linear Stochastic Bandits over a Bit-Constrained Channel A. Mitra Hamed Hassani George J. Pappas 39 8 0 02 Mar 2022
Bitwidth Heterogeneous Federated Learning with Progressive Weight Dequantization Jaehong Yoon Geondo Park Wonyong Jeong Sung Ju Hwang FedML 24 19 0 23 Feb 2022
DASHA: Distributed Nonconvex Optimization with Communication Compression, Optimal Oracle Complexity, and No Client Synchronization A. Tyurin Peter Richtárik 41 18 0 02 Feb 2022
Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank? Sheikh Shams Azam Seyyedali Hosseinalipour Qiang Qiu Christopher G. Brinton FedML 26 20 0 01 Feb 2022
Communication-Efficient Federated Learning with Accelerated Client Gradient Geeho Kim Jinkyu Kim Bohyung Han FedML 40 11 0 10 Jan 2022
Optimizing the Communication-Accuracy Trade-off in Federated Learning with Rate-Distortion Theory Nicole Mitchell Johannes Ballé Zachary B. Charles Jakub Konecný FedML 16 21 0 07 Jan 2022
Towards Federated Learning on Time-Evolving Heterogeneous Data Yongxin Guo Tao R. Lin Xiaoying Tang FedML 22 30 0 25 Dec 2021
Faster Rates for Compressed Federated Learning with Client-Variance Reduction Haoyu Zhao Konstantin Burlachenko Zhize Li Peter Richtárik FedML 27 13 0 24 Dec 2021
Optimal Rate Adaption in Federated Learning with Compressed Communications Laizhong Cui Xiaoxin Su Yipeng Zhou Jiangchuan Liu FedML 42 39 0 13 Dec 2021
Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications Khaled B. Letaief Yuanming Shi Jianmin Lu Jianhua Lu 43 416 0 24 Nov 2021
Wyner-Ziv Gradient Compression for Federated Learning Kai Liang Huiru Zhong Haoning Chen Youlong Wu FedML 23 8 0 16 Nov 2021
Finite-Time Consensus Learning for Decentralized Optimization with Nonlinear Gossiping Junya Chen Sijia Wang Lawrence Carin Chenyang Tao 8 3 0 04 Nov 2021
Privacy-Preserving Communication-Efficient Federated Multi-Armed Bandits Tan Li Linqi Song FedML 4 23 0 02 Nov 2021
Layer-wise Adaptive Model Aggregation for Scalable Federated Learning Sunwoo Lee Tuo Zhang Chaoyang He Salman Avestimehr FedML 6 48 0 19 Oct 2021
Adaptive Distillation: Aggregating Knowledge from Multiple Paths for Efficient Distillation Sumanth Chennupati Mohammad Mahdi Kamani Zhongwei Cheng Lin Chen 26 4 0 19 Oct 2021
Resource-constrained Federated Edge Learning with Heterogeneous Data: Formulation and Analysis Yi Liu Yuanshao Zhu James J. Q. Yu FedML 27 28 0 14 Oct 2021
Neural Tangent Kernel Empowered Federated Learning Kai Yue Richeng Jin Ryan Pilgrim Chau-Wai Wong D. Baron H. Dai FedML 22 17 0 07 Oct 2021
Federated Learning via Plurality Vote Kai Yue Richeng Jin Chau-Wai Wong H. Dai FedML 24 8 0 06 Oct 2021
FedDQ: Communication-Efficient Federated Learning with Descending Quantization Linping Qu Shenghui Song Chi-Ying Tsui FedML MQ 143 26 0 05 Oct 2021
Comfetch: Federated Learning of Large Networks on Constrained Clients via Sketching Tahseen Rabbani Brandon Yushan Feng Marco Bornstein Kyle Rui Sang Yifan Yang Arjun Rajkumar A. Varshney Furong Huang FedML 59 2 0 17 Sep 2021
Exploiting Heterogeneity in Robust Federated Best-Arm Identification A. Mitra Hamed Hassani George Pappas FedML 33 26 0 13 Sep 2021
Federated Multi-Task Learning under a Mixture of Distributions Othmane Marfoq Giovanni Neglia A. Bellet Laetitia Kameni Richard Vidal FedML 40 269 0 23 Aug 2021
FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learning Nam Hyeon-Woo Moon Ye-Bin Tae-Hyun Oh FedML 16 114 0 13 Aug 2021
Communication-Efficient Federated Learning via Predictive Coding Kai Yue Richeng Jin Chau-Wai Wong H. Dai FedML 25 14 0 02 Aug 2021
Finite-Bit Quantization For Distributed Algorithms With Linear Convergence Nicolò Michelusi G. Scutari Chang-Shen Lee MQ 11 27 0 23 Jul 2021
Towards Heterogeneous Clients with Elastic Federated Learning Zichen Ma Yu Lu Zihan Lu Wenye Li Jinfeng Yi Shuguang Cui FedML 19 3 0 17 Jun 2021
Robust Training in High Dimensions via Block Coordinate Geometric Median Descent Anish Acharya Abolfazl Hashemi Prateek Jain Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu 20 33 0 16 Jun 2021
QLSD: Quantised Langevin stochastic dynamics for Bayesian federated learning Maxime Vono Vincent Plassier Alain Durmus Aymeric Dieuleveut Eric Moulines FedML 35 35 0 01 Jun 2021
From Distributed Machine Learning to Federated Learning: A Survey Ji Liu Jizhou Huang Yang Zhou Xuhong Li Shilei Ji Haoyi Xiong Dejing Dou FedML OOD 51 244 0 29 Apr 2021
Communication-Efficient Agnostic Federated Averaging Jae Hun Ro Mingqing Chen Rajiv Mathews M. Mohri A. Suresh FedML 19 17 0 06 Apr 2021
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges Mingzhe Chen Deniz Gündüz Kaibin Huang Walid Saad M. Bennis Aneta Vulgarakis Feljan H. Vincent Poor 38 401 0 05 Apr 2021
Hierarchical Federated Learning with Quantization: Convergence Analysis and System Design Lumin Liu Jun Zhang Shenghui Song Khaled B. Letaief FedML 47 79 0 26 Mar 2021
FedDR -- Randomized Douglas-Rachford Splitting Algorithms for Nonconvex Federated Composite Optimization Quoc Tran-Dinh Nhan H. Pham Dzung Phan Lam M. Nguyen FedML 24 39 0 05 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 35 32 0 04 Mar 2021
Distributionally Robust Federated Averaging Yuyang Deng Mohammad Mahdi Kamani M. Mahdavi FedML 13 140 0 25 Feb 2021
MARINA: Faster Non-Convex Distributed Learning with Compression Eduard A. Gorbunov Konstantin Burlachenko Zhize Li Peter Richtárik 39 109 0 15 Feb 2021
Exploiting Shared Representations for Personalized Federated Learning Liam Collins Hamed Hassani Aryan Mokhtari Sanjay Shakkottai FedML OOD 37 692 0 14 Feb 2021
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients A. Mitra Rayana H. Jaafar George J. Pappas Hamed Hassani FedML 55 157 0 14 Feb 2021
Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data Tao R. Lin Sai Praneeth Karimireddy Sebastian U. Stich Martin Jaggi FedML 20 101 0 09 Feb 2021
Architectural Patterns for the Design of Federated Learning Systems Sin Kit Lo Qinghua Lu Liming Zhu Hye-Young Paik Xiwei Xu Chen Wang FedML AI4CE 15 64 0 07 Jan 2021
Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System Heterogeneity Amirhossein Reisizadeh Isidoros Tziotis Hamed Hassani Aryan Mokhtari Ramtin Pedarsani FedML 172 99 0 28 Dec 2020
Faster Non-Convex Federated Learning via Global and Local Momentum Rudrajit Das Anish Acharya Abolfazl Hashemi Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu FedML 37 82 0 07 Dec 2020
Advancements of federated learning towards privacy preservation: from federated learning to split learning Chandra Thapa Pathum Chamikara Mahawaga Arachchige S. Çamtepe FedML 22 82 0 25 Nov 2020
FedSKETCH: Communication-Efficient and Private Federated Learning via Sketching Farzin Haddadpour Belhal Karimi Ping Li Xiaoyun Li FedML 58 31 0 11 Aug 2020
Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications Jihong Park S. Samarakoon Anis Elgabli Joongheon Kim M. Bennis Seong-Lyun Kim Mérouane Debbah 34 161 0 06 Aug 2020
FedML: A Research Library and Benchmark for Federated Machine Learning Chaoyang He Songze Li Jinhyun So Xiao Zeng Mi Zhang ... Yang Liu Ramesh Raskar Qiang Yang M. Annavaram Salman Avestimehr FedML 168 564 0 27 Jul 2020
Adaptive Personalized Federated Learning Yuyang Deng Mohammad Mahdi Kamani M. Mahdavi FedML 212 60 0 30 Mar 2020
Stochastic-Sign SGD for Federated Learning with Theoretical Guarantees Richeng Jin Yufan Huang Xiaofan He H. Dai Tianfu Wu FedML 22 63 0 25 Feb 2020