v1v2 (latest)

Federated Learning with Compression: Unified Analysis and Sharp Guarantees

2 July 2020

Farzin Haddadpour

Mohammad Mahdi Kamani

Papers citing "Federated Learning with Compression: Unified Analysis and Sharp Guarantees"

50 / 151 papers shown

Title
FedVQCS: Federated Learning via Vector Quantized Compressed Sensing Yong-Nam Oh Yo-Seb Jeon Mingzhe Chen Walid Saad FedML 74 12 0 16 Apr 2022
FedSynth: Gradient Compression via Synthetic Data in Federated Learning Shengyuan Hu Jack Goetz Kshitiz Malik Hongyuan Zhan Zhe Liu Yue Liu DD FedML 95 40 0 04 Apr 2022
Learning Distributionally Robust Models at Scale via Composite Optimization Farzin Haddadpour Mohammad Mahdi Kamani M. Mahdavi Amin Karbasi OOD 69 5 0 17 Mar 2022
Privacy-Aware Compression for Federated Data Analysis Kamalika Chaudhuri Chuan Guo Michael G. Rabbat FedML 75 27 0 15 Mar 2022
Linear Stochastic Bandits over a Bit-Constrained Channel A. Mitra Hamed Hassani George J. Pappas 94 8 0 02 Mar 2022
Bitwidth Heterogeneous Federated Learning with Progressive Weight Dequantization Jaehong Yoon Geondo Park Wonyong Jeong Sung Ju Hwang FedML 79 19 0 23 Feb 2022
DASHA: Distributed Nonconvex Optimization with Communication Compression, Optimal Oracle Complexity, and No Client Synchronization Alexander Tyurin Peter Richtárik 119 19 0 02 Feb 2022
Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank? Sheikh Shams Azam Seyyedali Hosseinalipour Qiang Qiu Christopher G. Brinton FedML 101 21 0 01 Feb 2022
Communication-Efficient Federated Learning with Accelerated Client Gradient Geeho Kim Jinkyu Kim Bohyung Han FedML 69 14 0 10 Jan 2022
Optimizing the Communication-Accuracy Trade-off in Federated Learning with Rate-Distortion Theory Nicole Mitchell Johannes Ballé Zachary B. Charles Jakub Konecný FedML 128 21 0 07 Jan 2022
Towards Federated Learning on Time-Evolving Heterogeneous Data Yongxin Guo Tao R. Lin Xiaoying Tang FedML 90 31 0 25 Dec 2021
Faster Rates for Compressed Federated Learning with Client-Variance Reduction Haoyu Zhao Konstantin Burlachenko Zhize Li Peter Richtárik FedML 108 13 0 24 Dec 2021
Optimal Rate Adaption in Federated Learning with Compressed Communications Laizhong Cui Xiaoxin Su Yipeng Zhou Jiangchuan Liu FedML 92 42 0 13 Dec 2021
Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications Khaled B. Letaief Yuanming Shi Jianmin Lu Jianhua Lu 99 434 0 24 Nov 2021
Wyner-Ziv Gradient Compression for Federated Learning Kai Liang Huiru Zhong Haoning Chen Youlong Wu FedML 57 8 0 16 Nov 2021
Finite-Time Consensus Learning for Decentralized Optimization with Nonlinear Gossiping Junya Chen Sijia Wang Lawrence Carin Chenyang Tao 30 3 0 04 Nov 2021
Privacy-Preserving Communication-Efficient Federated Multi-Armed Bandits Tan Li Linqi Song FedML 57 24 0 02 Nov 2021
Layer-wise Adaptive Model Aggregation for Scalable Federated Learning Sunwoo Lee Tuo Zhang Chaoyang He Salman Avestimehr FedML 85 51 0 19 Oct 2021
Adaptive Distillation: Aggregating Knowledge from Multiple Paths for Efficient Distillation Sumanth Chennupati Mohammad Mahdi Kamani Zhongwei Cheng Lin Chen 76 4 0 19 Oct 2021
Resource-constrained Federated Edge Learning with Heterogeneous Data: Formulation and Analysis Yi Liu Yuanshao Zhu James Jianqiao Yu FedML 74 28 0 14 Oct 2021
Neural Tangent Kernel Empowered Federated Learning Kai Yue Richeng Jin Ryan Pilgrim Chau-Wai Wong D. Baron H. Dai FedML 73 17 0 07 Oct 2021
Federated Learning via Plurality Vote Kai Yue Richeng Jin Chau-Wai Wong H. Dai FedML 104 9 0 06 Oct 2021
FedDQ: Communication-Efficient Federated Learning with Descending Quantization Linping Qu Shenghui Song Chi-Ying Tsui FedML MQ 262 27 0 05 Oct 2021
Comfetch: Federated Learning of Large Networks on Constrained Clients via Sketching Tahseen Rabbani Brandon Yushan Feng Marco Bornstein Kyle Rui Sang Yifan Yang Arjun Rajkumar A. Varshney Furong Huang FedML 119 2 0 17 Sep 2021
Exploiting Heterogeneity in Robust Federated Best-Arm Identification A. Mitra Hamed Hassani George Pappas FedML 107 27 0 13 Sep 2021
Federated Multi-Task Learning under a Mixture of Distributions Othmane Marfoq Giovanni Neglia A. Bellet Laetitia Kameni Richard Vidal FedML 138 284 0 23 Aug 2021
FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learning Nam Hyeon-Woo Moon Ye-Bin Tae-Hyun Oh FedML 129 125 0 13 Aug 2021
Communication-Efficient Federated Learning via Predictive Coding Kai Yue Richeng Jin Chau-Wai Wong H. Dai FedML 78 14 0 02 Aug 2021
Finite-Bit Quantization For Distributed Algorithms With Linear Convergence Nicolò Michelusi G. Scutari Chang-Shen Lee MQ 71 27 0 23 Jul 2021
Towards Heterogeneous Clients with Elastic Federated Learning Zichen Ma Yu Lu Zihan Lu Wenye Li Jinfeng Yi Shuguang Cui FedML 41 3 0 17 Jun 2021
Robust Training in High Dimensions via Block Coordinate Geometric Median Descent Anish Acharya Abolfazl Hashemi Prateek Jain Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu 65 33 0 16 Jun 2021
QLSD: Quantised Langevin stochastic dynamics for Bayesian federated learning Maxime Vono Vincent Plassier Alain Durmus Hadrien Hendrikx Eric Moulines FedML 93 36 0 01 Jun 2021
From Distributed Machine Learning to Federated Learning: A Survey Ji Liu Jizhou Huang Yang Zhou Xuhong Li Shilei Ji Haoyi Xiong Dejing Dou FedML OOD 144 263 0 29 Apr 2021
Communication-Efficient Agnostic Federated Averaging Jae Hun Ro Mingqing Chen Rajiv Mathews M. Mohri A. Suresh FedML 72 17 0 06 Apr 2021
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges Mingzhe Chen Deniz Gündüz Kaibin Huang Walid Saad M. Bennis Aneta Vulgarakis Feljan H. Vincent Poor 139 419 0 05 Apr 2021
Hierarchical Federated Learning with Quantization: Convergence Analysis and System Design Lumin Liu Jun Zhang Shenghui Song Khaled B. Letaief FedML 70 87 0 26 Mar 2021
FedDR -- Randomized Douglas-Rachford Splitting Algorithms for Nonconvex Federated Composite Optimization Quoc Tran-Dinh Nhan H. Pham Dzung Phan Lam M. Nguyen FedML 119 42 0 05 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 133 35 0 04 Mar 2021
Distributionally Robust Federated Averaging Yuyang Deng Mohammad Mahdi Kamani M. Mahdavi FedML 70 143 0 25 Feb 2021
MARINA: Faster Non-Convex Distributed Learning with Compression Eduard A. Gorbunov Konstantin Burlachenko Zhize Li Peter Richtárik 102 110 0 15 Feb 2021
Exploiting Shared Representations for Personalized Federated Learning Liam Collins Hamed Hassani Aryan Mokhtari Sanjay Shakkottai FedML OOD 105 736 0 14 Feb 2021
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients A. Mitra Rayana H. Jaafar George J. Pappas Hamed Hassani FedML 114 160 0 14 Feb 2021
Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data Tao R. Lin Sai Praneeth Karimireddy Sebastian U. Stich Martin Jaggi FedML 107 101 0 09 Feb 2021
Architectural Patterns for the Design of Federated Learning Systems Sin Kit Lo Qinghua Lu Liming Zhu Hye-Young Paik Xiwei Xu Chen Wang FedML AI4CE 99 65 0 07 Jan 2021
Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System Heterogeneity Amirhossein Reisizadeh Isidoros Tziotis Hamed Hassani Aryan Mokhtari Ramtin Pedarsani FedML 236 102 0 28 Dec 2020
Faster Non-Convex Federated Learning via Global and Local Momentum Rudrajit Das Anish Acharya Abolfazl Hashemi Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu FedML 100 84 0 07 Dec 2020
Advancements of federated learning towards privacy preservation: from federated learning to split learning Chandra Thapa Pathum Chamikara Mahawaga Arachchige S. Çamtepe FedML 75 87 0 25 Nov 2020
FedSKETCH: Communication-Efficient and Private Federated Learning via Sketching Farzin Haddadpour Belhal Karimi Ping Li Xiaoyun Li FedML 82 32 0 11 Aug 2020
Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications Jihong Park S. Samarakoon Anis Elgabli Joongheon Kim M. Bennis Seong-Lyun Kim Mérouane Debbah 102 164 0 06 Aug 2020
FedML: A Research Library and Benchmark for Federated Machine Learning Chaoyang He Songze Li Jinhyun So Xiao Zeng Mi Zhang ... Yang Liu Ramesh Raskar Qiang Yang M. Annavaram Salman Avestimehr FedML 269 578 0 27 Jul 2020