FetchSGD: Communication-Efficient Federated Learning with Sketching

15 July 2020

Papers citing "FetchSGD: Communication-Efficient Federated Learning with Sketching"

50 / 172 papers shown

Title
Towards Artificial General or Personalized Intelligence? A Survey on Foundation Models for Personalized Federated Intelligence Yu Qiao Huy Q. Le Avi Deb Raha Phuong-Nam Tran Apurba Adhikary Mengchun Zhang Loc X. Nguyen Eui-nam Huh Dusit Niyato Choong Seon Hong AI4CE 31 0 0 11 May 2025
FedFetch: Faster Federated Learning with Adaptive Downstream Prefetching Qifan Yan Andrew Liu Shiqi He Mathias Lécuyer Ivan Beschastnikh FedML 36 0 0 21 Apr 2025
FedDyMem: Efficient Federated Learning with Dynamic Memory and Memory-Reduce for Unsupervised Image Anomaly Detection Silin Chen Kangjian Di Yichu Xu Han-Jia Ye Wenhan Luo Ningmu Zou FedML 45 0 0 28 Feb 2025
Comprehensive Study on Lumbar Disc Segmentation Techniques Using MRI Data Serkan Salturk Irem Sayin Ibrahim Cem Balci Taha Emre Pamukcu Zafer Soydan Huseyin Uvet 38 0 0 25 Dec 2024
MARINA-P: Superior Performance in Non-smooth Federated Optimization with Adaptive Stepsizes Igor Sokolov Peter Richtárik 77 1 0 22 Dec 2024
Task Diversity in Bayesian Federated Learning: Simultaneous Processing of Classification and Regression Junliang Lyu Yixuan Zhang Xiaoling Lu Feng Zhou FedML 75 0 0 14 Dec 2024
Problem-dependent convergence bounds for randomized linear gradient compression Thomas Flynn Patrick R. Johnstone Shinjae Yoo 59 0 0 19 Nov 2024
Sketched Adaptive Federated Deep Learning: A Sharp Convergence Analysis Zhijie Chen Qiaobo Li A. Banerjee FedML 35 0 0 11 Nov 2024
Personalized Federated Learning with Mixture of Models for Adaptive Prediction and Model Fine-Tuning P. M. Ghari Yanning Shen FedML 25 1 0 28 Oct 2024
Private and Communication-Efficient Federated Learning based on Differentially Private Sketches Meifan Zhang Zhanhong Xie Lihua Yin FedML 29 1 0 08 Oct 2024
ParallelSFL: A Novel Split Federated Learning Framework Tackling Heterogeneity Issues Yunming Liao Yang Xu Hongli Xu Zhiwei Yao Liusheng Huang C. Qiao FedML 45 5 0 02 Oct 2024
Selective Aggregation for Low-Rank Adaptation in Federated Learning Pengxin Guo Shuang Zeng Y. Wang Huijie Fan Feifei Wang Liangqiong Qu FedML 44 10 0 02 Oct 2024
From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcare Ming Li Pengcheng Xu Junjie Hu Zeyu Tang Guang Yang FedML 48 1 0 15 Sep 2024
Sequential Federated Learning in Hierarchical Architecture on Non-IID Datasets Xingrun Yan Shiyuan Zuo Rongfei Fan Han Hu Li Shen Puning Zhao Yong Luo FedML 55 0 0 19 Aug 2024
Efficient Federated Learning Using Dynamic Update and Adaptive Pruning with Momentum on Shared Server Data Ji Liu Juncheng Jia Hong Zhang Yuhui Yun Leye Wang Yang Zhou H. Dai Dejing Dou FedML 30 5 0 11 Aug 2024
Privacy-Preserved Taxi Demand Prediction System Utilizing Distributed Data Ren Ozeki Haruki Yonekura Hamada Rizk Hirozumi Yamaguchi 26 1 0 09 Aug 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 80 1 0 30 Jul 2024
CDFL: Efficient Federated Human Activity Recognition using Contrastive Learning and Deep Clustering Ensieh Khazaei Alireza Esmaeilzehi Bilal Taha Dimitrios Hatzinakos FedML 28 1 0 17 Jul 2024
Recent and Upcoming Developments in Randomized Numerical Linear Algebra for Machine Learning Michał Dereziński Michael W. Mahoney 28 5 0 17 Jun 2024
Knowledge Distillation in Federated Learning: a Survey on Long Lasting Challenges and New Solutions Laiqiao Qin Tianqing Zhu Wanlei Zhou Philip S. Yu 43 5 0 16 Jun 2024
Loss Gradient Gaussian Width based Generalization and Optimization Guarantees A. Banerjee Qiaobo Li Yingxue Zhou 49 0 0 11 Jun 2024
Communication-Efficient Distributed Deep Learning via Federated Dynamic Averaging Michail Theologitis Georgios Frangias Georgios Anestis V. Samoladas Antonios Deligiannakis FedML 40 0 0 31 May 2024
VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections Roy Miles Pradyumna Reddy Ismail Elezi Jiankang Deng VLM 43 3 0 28 May 2024
Distributed Continual Learning Long Le Marcel Hussing Eric Eaton CLL FedML 39 2 0 23 May 2024
Communication-Efficient Federated Learning with Adaptive Compression under Dynamic Bandwidth Zhuansun Ying Dandan Li Xiaohong Huang Caijun Sun FedML 22 0 0 06 May 2024
Improved Communication-Privacy Trade-offs in $L_2$ Mean Estimation under Streaming Differential Privacy Wei-Ning Chen Berivan Isik Peter Kairouz Albert No Sewoong Oh Zheng Xu 57 3 0 02 May 2024
FedMPQ: Secure and Communication-Efficient Federated Learning with Multi-codebook Product Quantization Xu Yang Jiapeng Zhang Qifeng Zhang Zhuo Tang MQ 33 0 0 21 Apr 2024
Socialized Learning: A Survey of the Paradigm Shift for Edge Intelligence in Networked Systems Xiaofei Wang Yunfeng Zhao Chao Qiu Qinghua Hu Victor C. M. Leung 35 6 0 20 Apr 2024
SignSGD with Federated Voting Chanho Park H. Vincent Poor Namyoon Lee FedML 40 1 0 25 Mar 2024
Fed-CVLC: Compressing Federated Learning Communications with Variable-Length Codes Xiaoxin Su Yipeng Zhou Laizhong Cui John C. S. Lui Jiangchuan Liu FedML 35 1 0 06 Feb 2024
Flora: Low-Rank Adapters Are Secretly Gradient Compressors Yongchang Hao Yanshuai Cao Lili Mou 16 39 0 05 Feb 2024
SignSGD with Federated Defense: Harnessing Adversarial Attacks through Gradient Sign Decoding Chanho Park Namyoon Lee FedML AAML 24 1 0 02 Feb 2024
Improved Quantization Strategies for Managing Heavy-tailed Gradients in Distributed Learning Guangfeng Yan Tan Li Yuanzhang Xiao Hanxu Hou Linqi Song MQ 29 0 0 02 Feb 2024
Privacy-Preserving Data Fusion for Traffic State Estimation: A Vertical Federated Learning Approach Qiqing Wang Kaidi Yang FedML 39 8 0 22 Jan 2024
Budgeted Online Model Selection and Fine-Tuning via Federated Learning P. M. Ghari Yanning Shen FedML 46 1 0 19 Jan 2024
The Effects of Data Imbalance Under a Federated Learning Approach for Credit Risk Forecasting Shuyao Zhang Jordan Tay Pedro Baiz FedML 35 1 0 14 Jan 2024
Sparse Training for Federated Learning with Regularized Error Correction Ran Greidi Kobi Cohen FedML 30 1 0 21 Dec 2023
On the Role of Server Momentum in Federated Learning Jianhui Sun Xidong Wu Heng-Chiao Huang Aidong Zhang FedML 60 11 0 19 Dec 2023
Layered Randomized Quantization for Communication-Efficient and Privacy-Preserving Distributed Learning Guangfeng Yan Tan Li Tian-Shing Lan Kui Wu Linqi Song 19 6 0 12 Dec 2023
Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes Zhen Qin Daoyuan Chen Bingchen Qian Bolin Ding Yaliang Li Shuiguang Deng FedML 37 32 0 11 Dec 2023
VeryFL: A Verify Federated Learning Framework Embedded with Blockchain Yihao Li Yanyi Lai Chuan Chen Zibin Zheng FedML 50 3 0 27 Nov 2023
MergeSFL: Split Federated Learning with Feature Merging and Batch Size Regulation Yunming Liao Yang Xu Hong-Ze Xu Lun Wang Zhiwei Yao C. Qiao FedML MoMe 38 10 0 22 Nov 2023
Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training Lianke Qin Saayan Mitra Zhao-quan Song Yuanyuan Yang Dinesh Manocha 27 0 0 19 Nov 2023
Personalized Online Federated Learning with Multiple Kernels P. M. Ghari Yanning Shen 49 13 0 09 Nov 2023
Correlation Aware Sparsified Mean Estimation Using Random Projection Shuli Jiang Pranay Sharma Gauri Joshi 35 1 0 29 Oct 2023
LASER: Linear Compression in Wireless Distributed Optimization Ashok Vardhan Makkuva Marco Bondaschi Thijs Vogels Martin Jaggi Hyeji Kim Michael C. Gastpar 84 3 0 19 Oct 2023
Over-the-Air Federated Learning and Optimization Jingyang Zhu Yuanming Shi Yong Zhou Chunxiao Jiang Wei Chen Khaled B. Letaief FedML 23 11 0 16 Oct 2023
FedNAR: Federated Optimization with Normalized Annealing Regularization Junbo Li Ang Li Chong Tian Qirong Ho Eric P. Xing Hongyi Wang FedML 24 5 0 04 Oct 2023
PA-iMFL: Communication-Efficient Privacy Amplification Method against Data Reconstruction Attack in Improved Multi-Layer Federated Learning Jianhua Wang Xiaolin Chang Jelena Mivsić Vojislav B. Mivsić Zhi Chen Junchao Fan 39 2 0 25 Sep 2023
CORE: Common Random Reconstruction for Distributed Optimization with Provable Low Communication Complexity Pengyun Yue Hanzheng Zhao Cong Fang Di He Liwei Wang Zhouchen Lin Song-Chun Zhu 40 1 0 23 Sep 2023