Distributed Mean Estimation with Limited Communication

2 November 2016

Sanjiv Kumar

Papers citing "Distributed Mean Estimation with Limited Communication"

50 / 71 papers shown

Title
Convergence Analysis of Asynchronous Federated Learning with Gradient Compression for Non-Convex Optimization Diying Yang Yingwei Hou Danyang Xiao Weigang Wu FedML 39 0 0 28 Apr 2025
Universal Exact Compression of Differentially Private Mechanisms Yanxiao Liu Wei-Ning Chen Ayfer Özgür Cheuk Ting Li 42 2 0 28 May 2024
Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey Feng Liang Zhen Zhang Haifeng Lu Victor C. M. Leung Yanyi Guo Xiping Hu GNN 37 6 0 09 Apr 2024
Fed-CVLC: Compressing Federated Learning Communications with Variable-Length Codes Xiaoxin Su Yipeng Zhou Laizhong Cui John C. S. Lui Jiangchuan Liu FedML 39 1 0 06 Feb 2024
Correlated Quantization for Faster Nonconvex Distributed Optimization Andrei Panferov Yury Demidovich Ahmad Rammal Peter Richtárik MQ 47 4 0 10 Jan 2024
Kimad: Adaptive Gradient Compression with Bandwidth Awareness Jihao Xin Ivan Ilin Shunkang Zhang Marco Canini Peter Richtárik 40 3 0 13 Dec 2023
Matrix Compression via Randomized Low Rank and Low Precision Factorization R. Saha Varun Srivastava Mert Pilanci 26 19 0 17 Oct 2023
Communication Compression for Byzantine Robust Learning: New Efficient Algorithms and Improved Rates Ahmad Rammal Kaja Gruntkowska Nikita Fedin Eduard A. Gorbunov Peter Richtárik 45 5 0 15 Oct 2023
Fundamental Limits of Distributed Optimization over Multiple Access Channel Shubham K. Jha 23 1 0 05 Oct 2023
Communication Efficient Private Federated Learning Using Dithering Burak Hasircioglu Deniz Gunduz FedML 45 7 0 14 Sep 2023
Maestro: Uncovering Low-Rank Structures via Trainable Decomposition Samuel Horváth Stefanos Laskaridis Shashank Rajput Hongyi Wang BDL 32 4 0 28 Aug 2023
Differentially Private Aggregation via Imperfect Shuffling Badih Ghazi Ravi Kumar Pasin Manurangsi Jelani Nelson Samson Zhou FedML 30 1 0 28 Aug 2023
Exact Optimality of Communication-Privacy-Utility Tradeoffs in Distributed Mean Estimation Berivan Isik Wei-Ning Chen Ayfer Özgür Tsachy Weissman Albert No 61 19 0 08 Jun 2023
Private and Communication-Efficient Algorithms for Entropy Estimation Gecia Bravo Hermsdorff R. Busa-Fekete Mohammad Ghavamzadeh Andrés Munoz Medina Umar Syed 41 2 0 12 May 2023
Collaborative Mean Estimation over Intermittently Connected Networks with Peer-To-Peer Privacy R. Saha Mohamed Seif M. Yemini Andrea J. Goldsmith H. Vincent Poor FedML 29 2 0 28 Feb 2023
Breaking the Communication-Privacy-Accuracy Tradeoff with $f$ -Differential Privacy Richeng Jin Z. Su C. Zhong Zhaoyang Zhang Tony Q.S. Quek H. Dai FedML 29 2 0 19 Feb 2023
DoCoFL: Downlink Compression for Cross-Device Federated Learning Ron Dorfman S. Vargaftik Y. Ben-Itzhak Kfir Y. Levy FedML 32 19 0 01 Feb 2023
Does Federated Learning Really Need Backpropagation? H. Feng Tianyu Pang Chao Du Wei Chen Shuicheng Yan Min-Bin Lin FedML 36 10 0 28 Jan 2023
Distributed Linear Bandits under Communication Constraints Sudeep Salgia Qing Zhao 32 7 0 04 Nov 2022
Adaptive Compression for Communication-Efficient Distributed Training Maksim Makarenko Elnur Gasanov Rustem Islamov Abdurakhmon Sadiev Peter Richtárik 39 13 0 31 Oct 2022
A Fast Blockchain-based Federated Learning Framework with Compressed Communications Laizhong Cui Xiaoxin Su Yipeng Zhou FedML 22 23 0 12 Aug 2022
Towards Efficient Communications in Federated Learning: A Contemporary Survey Zihao Zhao Yuzhu Mao Yang Liu Linqi Song Ouyang Ye Xinlei Chen Wenbo Ding FedML 59 60 0 02 Aug 2022
sqSGD: Locally Private and Communication Efficient Federated Learning Yan Feng Tao Xiong Ruofan Wu Lingjuan Lv Leilei Shi FedML 28 2 0 21 Jun 2022
On the Generalization of Wasserstein Robust Federated Learning Tung Nguyen Tuan Dung Nguyen Long Tan Le Canh T. Dinh N. H. Tran OOD FedML 29 6 0 03 Jun 2022
Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints Mónica Ribero H. Vikalo G. Veciana FedML 24 43 0 13 May 2022
FedSynth: Gradient Compression via Synthetic Data in Federated Learning Shengyuan Hu Jack Goetz Kshitiz Malik Hongyuan Zhan Zhe Liu Yue Liu DD FedML 40 38 0 04 Apr 2022
Distributed Riemannian Optimization with Lazy Communication for Collaborative Geometric Estimation Yulun Tian Amrit Singh Bedi Alec Koppel Miguel Calvo-Fullana David M. Rosen Jonathan P. How 22 5 0 02 Mar 2022
Towards Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search Chunhui Zhang Xiaoming Yuan Qianyun Zhang Guangxu Zhu Lei Cheng Ning Zhang FedML OOD 17 15 0 23 Feb 2022
FedSpace: An Efficient Federated Learning Framework at Satellites and Ground Stations Jinhyun So Kevin Hsieh Behnaz Arzani Shadi Noghabi Salman Avestimehr Ranveer Chandra FedML 16 60 0 02 Feb 2022
Optimizing the Communication-Accuracy Trade-off in Federated Learning with Rate-Distortion Theory Nicole Mitchell Johannes Ballé Zachary B. Charles Jakub Konecný FedML 16 21 0 07 Jan 2022
Optimal Rate Adaption in Federated Learning with Compressed Communications Laizhong Cui Xiaoxin Su Yipeng Zhou Jiangchuan Liu FedML 42 39 0 13 Dec 2021
Wyner-Ziv Gradient Compression for Federated Learning Kai Liang Huiru Zhong Haoning Chen Youlong Wu FedML 23 8 0 16 Nov 2021
Optimal Compression of Locally Differentially Private Mechanisms Abhin Shah Wei-Ning Chen Johannes Ballé Peter Kairouz Lucas Theis 35 42 0 29 Oct 2021
Leveraging Spatial and Temporal Correlations in Sparsified Mean Estimation Divyansh Jhunjhunwala Ankur Mallick Advait Gadhikar S. Kadhe Gauri Joshi 24 10 0 14 Oct 2021
Communication-Efficient Federated Learning with Binary Neural Networks YuZhi Yang Zhaoyang Zhang Qianqian Yang FedML 32 31 0 05 Oct 2021
Solon: Communication-efficient Byzantine-resilient Distributed Training via Redundant Gradients Lingjiao Chen Leshang Chen Hongyi Wang S. Davidson Yan Sun FedML 37 1 0 04 Oct 2021
Differentially Private Aggregation in the Shuffle Model: Almost Central Accuracy in Almost a Single Message Badih Ghazi Ravi Kumar Pasin Manurangsi Rasmus Pagh Amer Sinha FedML 65 36 0 27 Sep 2021
Fundamental limits of over-the-air optimization: Are analog schemes optimal? Shubham K. Jha Prathamesh Mayekar Himanshu Tyagi 24 7 0 11 Sep 2021
EDEN: Communication-Efficient and Robust Distributed Mean Estimation for Federated Learning S. Vargaftik Ran Ben-Basat Amit Portnoy Gal Mendelson Y. Ben-Itzhak Michael Mitzenmacher FedML 46 46 0 19 Aug 2021
FedJAX: Federated learning simulation with JAX Jae Hun Ro A. Suresh Ke Wu FedML 33 48 0 04 Aug 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 187 412 0 14 Jul 2021
A Decentralized Adaptive Momentum Method for Solving a Class of Min-Max Optimization Problems Babak Barazandeh Tianjian Huang George Michailidis 27 12 0 10 Jun 2021
Private Counting from Anonymous Messages: Near-Optimal Accuracy with Vanishing Communication Overhead Badih Ghazi Ravi Kumar Pasin Manurangsi Rasmus Pagh FedML 32 48 0 08 Jun 2021
Slashing Communication Traffic in Federated Learning by Transmitting Clustered Model Updates Laizhong Cui Xiaoxin Su Yipeng Zhou Yi Pan FedML 38 36 0 10 May 2021
Efficient Randomized Subspace Embeddings for Distributed Optimization under a Communication Budget R. Saha Mert Pilanci Andrea J. Goldsmith 34 5 0 13 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 35 32 0 04 Mar 2021
On the Utility of Gradient Compression in Distributed Training Systems Saurabh Agarwal Hongyi Wang Shivaram Venkataraman Dimitris Papailiopoulos 31 46 0 28 Feb 2021
MARINA: Faster Non-Convex Distributed Learning with Compression Eduard A. Gorbunov Konstantin Burlachenko Zhize Li Peter Richtárik 39 109 0 15 Feb 2021
The Distributed Discrete Gaussian Mechanism for Federated Learning with Secure Aggregation Peter Kairouz Ziyu Liu Thomas Steinke FedML 44 232 0 12 Feb 2021
Faster Non-Convex Federated Learning via Global and Local Momentum Rudrajit Das Anish Acharya Abolfazl Hashemi Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu FedML 37 82 0 07 Dec 2020