FetchSGD: Communication-Efficient Federated Learning with Sketching

15 July 2020

Papers citing "FetchSGD: Communication-Efficient Federated Learning with Sketching"

50 / 172 papers shown

Title
FedComm: Understanding Communication Protocols for Edge-based Federated Learning Gary Cleland Di Wu R. Ullah Blesson Varghese 25 6 0 18 Aug 2022
FedOBD: Opportunistic Block Dropout for Efficiently Training Large-scale Neural Networks through Federated Learning Yuanyuan Chen Zichen Chen Pengcheng Wu Han Yu AI4CE 14 18 0 10 Aug 2022
Towards Efficient Communications in Federated Learning: A Contemporary Survey Zihao Zhao Yuzhu Mao Yang Liu Linqi Song Ouyang Ye Xinlei Chen Wenbo Ding FedML 54 59 0 02 Aug 2022
Reconciling Security and Communication Efficiency in Federated Learning Karthik Prasad Sayan Ghosh Graham Cormode Ilya Mironov Ashkan Yousefpour Pierre Stock FedML 32 8 0 26 Jul 2022
FedNet2Net: Saving Communication and Computations in Federated Learning with Model Growing A. Kundu J. JáJá FedML 22 3 0 19 Jul 2022
Accelerated Federated Learning with Decoupled Adaptive Optimization Jiayin Jin Jiaxiang Ren Yang Zhou Lingjuan Lyu Ji Liu Dejing Dou AI4CE FedML 19 51 0 14 Jul 2022
Tricking the Hashing Trick: A Tight Lower Bound on the Robustness of CountSketch to Adaptive Inputs Edith Cohen Jelani Nelson Tamas Sarlos Uri Stemmer AAML 23 8 0 03 Jul 2022
Personalized Federated Learning via Variational Bayesian Inference Xu Zhang Yinchuan Li Wenpeng Li Kaiyang Guo Yunfeng Shao FedML 49 85 0 16 Jun 2022
Anchor Sampling for Federated Learning with Partial Client Participation Feijie Wu Song Guo Zhihao Qu Shiqi He Ziming Liu Jing Gao FedML 28 12 0 13 Jun 2022
Neurotoxin: Durable Backdoors in Federated Learning Zhengming Zhang Ashwinee Panda Linyue Song Yaoqing Yang Michael W. Mahoney Joseph E. Gonzalez Kannan Ramchandran Prateek Mittal FedML 38 130 0 12 Jun 2022
Federated Offline Reinforcement Learning D. Zhou Yufeng Zhang Aaron Sonabend-W Zhaoran Wang Junwei Lu Tianxi Cai OffRL 31 13 0 11 Jun 2022
Communication-Efficient Robust Federated Learning with Noisy Labels Junyi Li Jian Pei Heng Huang FedML 20 18 0 11 Jun 2022
Swan: A Neural Engine for Efficient DNN Training on Smartphone SoCs Sanjay Sri Vallabh Singapuram Fan Lai Chuheng Hu Mosharaf Chowdhury 19 5 0 09 Jun 2022
Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees Jue Wang Binhang Yuan Luka Rimanic Yongjun He Tri Dao Beidi Chen Christopher Ré Ce Zhang AI4CE 24 11 0 02 Jun 2022
Can Foundation Models Help Us Achieve Perfect Secrecy? Simran Arora Christopher Ré FedML 24 6 0 27 May 2022
Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking Zhenxiao Zhang Zhidong Gao Yuanxiong Guo Yanmin Gong FedML 15 33 0 25 May 2022
Decentral and Incentivized Federated Learning Frameworks: A Systematic Literature Review Leon Witt Mathis Heyer Kentaroh Toyoda Wojciech Samek Dan Li FedML 33 47 0 07 May 2022
The Fundamental Price of Secure Aggregation in Differentially Private Federated Learning Wei-Ning Chen Christopher A. Choquette-Choo Peter Kairouz A. Suresh FedML 39 63 0 07 Mar 2022
Acceleration of Federated Learning with Alleviated Forgetting in Local Training Chencheng Xu Zhiwei Hong Minlie Huang Tao Jiang FedML 24 45 0 05 Mar 2022
On the Robustness of CountSketch to Adaptive Inputs E. Cohen Xin Lyu Jelani Nelson Tamas Sarlos M. Shechner Uri Stemmer AAML 11 22 0 28 Feb 2022
Graph-Assisted Communication-Efficient Ensemble Federated Learning P. M. Ghari Yanning Shen FedML 24 4 0 27 Feb 2022
Trusted AI in Multi-agent Systems: An Overview of Privacy and Security for Distributed Learning Chuan Ma Jun Li Kang Wei Bo Liu Ming Ding Long Yuan Zhu Han H. Vincent Poor 51 42 0 18 Feb 2022
Do Gradient Inversion Attacks Make Federated Learning Unsafe? Ali Hatamizadeh Hongxu Yin Pavlo Molchanov Andriy Myronenko Wenqi Li ... Andrew Feng Mona G. Flores Jan Kautz Daguang Xu H. Roth FedML 33 61 0 14 Feb 2022
FedSpace: An Efficient Federated Learning Framework at Satellites and Ground Stations Jinhyun So Kevin Hsieh Behnaz Arzani Shadi Noghabi Salman Avestimehr Ranveer Chandra FedML 16 60 0 02 Feb 2022
Federated Active Learning (F-AL): an Efficient Annotation Strategy for Federated Learning J. Ahn Yeeun Ma Seoyun Park Cheolwoo You FedML 45 22 0 01 Feb 2022
A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning S. Zhang Jieyu Lin Qi Zhang 35 63 0 09 Jan 2022
Optimizing the Communication-Accuracy Trade-off in Federated Learning with Rate-Distortion Theory Nicole Mitchell Johannes Ballé Zachary B. Charles Jakub Konecný FedML 16 21 0 07 Jan 2022
Communication-Efficient Distributed SGD with Compressed Sensing Yujie Tang V. Ramanathan Junshan Zhang Na Li FedML 28 8 0 15 Dec 2021
SparseFed: Mitigating Model Poisoning Attacks in Federated Learning with Sparsification Ashwinee Panda Saeed Mahloujifar A. Bhagoji Supriyo Chakraborty Prateek Mittal FedML AAML 17 84 0 12 Dec 2021
Intrinisic Gradient Compression for Federated Learning Luke Melas-Kyriazi Franklyn Wang FedML 18 3 0 05 Dec 2021
FedCV: A Federated Learning Framework for Diverse Computer Vision Tasks Chaoyang He Alay Dilipbhai Shah Zhenheng Tang Adarshan Naiynar Sivashunmugam Keerti Bhogaraju Mita Shimpi Li Shen X. Chu Mahdi Soltanolkotabi Salman Avestimehr VLM FedML 37 68 0 22 Nov 2021
To Talk or to Work: Delay Efficient Federated Learning over Mobile Edge Devices Pavana Prakash Jiahao Ding Maoqiang Wu Minglei Shu Rong Yu Miao Pan FedML 35 3 0 01 Nov 2021
DAdaQuant: Doubly-adaptive quantization for communication-efficient Federated Learning Robert Hönig Yiren Zhao Robert D. Mullins FedML 109 54 0 31 Oct 2021
ADDS: Adaptive Differentiable Sampling for Robust Multi-Party Learning Maoguo Gong Yuan Gao Yue Wu •. A. K. Qin FedML OOD 6 1 0 29 Oct 2021
FedSpeech: Federated Text-to-Speech with Continual Learning Ziyue Jiang Yi Ren Ming Lei Zhou Zhao FedML 98 24 0 14 Oct 2021
Federated Learning via Plurality Vote Kai Yue Richeng Jin Chau-Wai Wong H. Dai FedML 24 8 0 06 Oct 2021
Comfetch: Federated Learning of Large Networks on Constrained Clients via Sketching Tahseen Rabbani Brandon Yushan Feng Marco Bornstein Kyle Rui Sang Yifan Yang Arjun Rajkumar A. Varshney Furong Huang FedML 59 2 0 17 Sep 2021
Critical Learning Periods in Federated Learning Gang Yan Hao Wang Jian Li FedML 28 8 0 12 Sep 2021
Communication Efficient Generalized Tensor Factorization for Decentralized Healthcare Networks Jing Ma Qiuchen Zhang Jian Lou Li Xiong S. Bhavani Joyce C. Ho 18 0 0 03 Sep 2021
FedKD: Communication Efficient Federated Learning via Knowledge Distillation Chuhan Wu Fangzhao Wu Lingjuan Lyu Yongfeng Huang Xing Xie FedML 27 373 0 30 Aug 2021
A Distributed SGD Algorithm with Global Sketching for Deep Learning Training Acceleration Lingfei Dai Boyu Diao Chao Li Yongjun Xu 35 5 0 13 Aug 2021
Communication Optimization in Large Scale Federated Learning using Autoencoder Compressed Weight Updates Srikanth Chandar Pravin Chandran Raghavendra Bhat Avinash Chakravarthi AI4CE 31 3 0 12 Aug 2021
Communication Efficiency in Federated Learning: Achievements and Challenges Osama Shahid Seyedamin Pouriyeh R. Parizi Quan Z. Sheng Gautam Srivastava Liang Zhao FedML 40 74 0 23 Jul 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 187 412 0 14 Jul 2021
Towards Representation Identical Privacy-Preserving Graph Neural Network via Split Learning Chuanqiang Shan Hui Jiao Jie Fu 21 14 0 13 Jul 2021
H-FL: A Hierarchical Communication-Efficient and Privacy-Protected Architecture for Federated Learning He Yang 14 27 0 01 Jun 2021
FedScale: Benchmarking Model and System Performance of Federated Learning at Scale Fan Lai Yinwei Dai Sanjay Sri Vallabh Singapuram Jiachen Liu Xiangfeng Zhu H. Madhyastha Mosharaf Chowdhury FedML 42 194 0 24 May 2021
DRIVE: One-bit Distributed Mean Estimation S. Vargaftik Ran Ben-Basat Amit Portnoy Gal Mendelson Y. Ben-Itzhak Michael Mitzenmacher OOD FedML 82 51 0 18 May 2021
EasyFL: A Low-code Federated Learning Platform For Dummies Weiming Zhuang Xin Gan Yonggang Wen Shuai Zhang FedML 27 46 0 17 May 2021
From Distributed Machine Learning to Federated Learning: A Survey Ji Liu Jizhou Huang Yang Zhou Xuhong Li Shilei Ji Haoyi Xiong Dejing Dou FedML OOD 51 244 0 29 Apr 2021