Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms

22 August 2018

Papers citing "Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms"

50 / 209 papers shown

Title
Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications Khaled B. Letaief Yuanming Shi Jianmin Lu Jianhua Lu 34 416 0 24 Nov 2021
DACFL: Dynamic Average Consensus Based Federated Learning in Decentralized Topology Zhikun Chen Daofeng Li Jinkang Zhu Sihai Zhang FedML 31 8 0 10 Nov 2021
Sharp Bounds for Federated Averaging (Local SGD) and Continuous Perspective Margalit Glasgow Honglin Yuan Tengyu Ma FedML 27 43 0 05 Nov 2021
Data Selection for Efficient Model Update in Federated Learning Hongrui Shi Valentin Radu FedML 31 5 0 05 Nov 2021
A Personalized Federated Learning Algorithm: an Application in Anomaly Detection Ali Anaissi Basem Suleiman FedML 27 1 0 04 Nov 2021
What Do We Mean by Generalization in Federated Learning? Honglin Yuan Warren Morningstar Lin Ning K. Singhal OOD FedML 41 71 0 27 Oct 2021
Layer-wise Adaptive Model Aggregation for Scalable Federated Learning Sunwoo Lee Tuo Zhang Chaoyang He Salman Avestimehr FedML 6 48 0 19 Oct 2021
BEV-SGD: Best Effort Voting SGD for Analog Aggregation Based Federated Learning against Byzantine Attackers Xin-Yue Fan Yue Wang Yan Huo Zhi Tian FedML 22 23 0 18 Oct 2021
Trade-offs of Local SGD at Scale: An Empirical Study Jose Javier Gonzalez Ortiz Jonathan Frankle Michael G. Rabbat Ari S. Morcos Nicolas Ballas FedML 37 19 0 15 Oct 2021
Deep Federated Learning for Autonomous Driving A. Nguyen Tuong Khanh Long Do Minh-Ngoc Tran Binh X. Nguyen C. Duong T. Phan Erman Tjiputra Quang-Dieu Tran FedML 28 109 0 12 Oct 2021
Federated Learning via Plurality Vote Kai Yue Richeng Jin Chau-Wai Wong H. Dai FedML 24 8 0 06 Oct 2021
Paving the Way for Distributed Artificial Intelligence over the Air Guoqing Ma Shuping Dang Chuanting Zhang B. Shihada 16 3 0 24 Sep 2021
Personalized Federated Learning for Heterogeneous Clients with Clustered Knowledge Transfer Yae Jee Cho Jianyu Wang Tarun Chiruvolu Gauri Joshi FedML 35 30 0 16 Sep 2021
Exploiting Heterogeneity in Robust Federated Best-Arm Identification A. Mitra Hamed Hassani George Pappas FedML 31 26 0 13 Sep 2021
Cost-Effective Federated Learning in Mobile Edge Networks Bing Luo Xiang Li Shiqiang Wang Jianwei Huang Leandros Tassiulas FedML 54 72 0 12 Sep 2021
Statistical Estimation and Inference via Local SGD in Federated Learning Xiang Li Jiadong Liang Xiangyu Chang Zhihua Zhang FedML 27 4 0 03 Sep 2021
Anarchic Federated Learning Haibo Yang Xin Zhang Prashant Khanduri Jia Liu FedML 18 58 0 23 Aug 2021
Mobility-Aware Cluster Federated Learning in Hierarchical Wireless Networks Chenyuan Feng H. Yang Deshun Hu Zhiwei Zhao Tony Q. S. Quek Geyong Min 36 74 0 20 Aug 2021
Cross-Silo Federated Learning for Multi-Tier Networks with Vertical and Horizontal Data Partitioning Anirban Das Timothy Castiglia Shiqiang Wang S. Patterson FedML 13 19 0 19 Aug 2021
FedChain: Chained Algorithms for Near-Optimal Communication Cost in Federated Learning Charlie Hou K. K. Thekumparampil Giulia Fanti Sewoong Oh FedML 30 14 0 16 Aug 2021
Communication-Efficient Federated Learning via Predictive Coding Kai Yue Richeng Jin Chau-Wai Wong H. Dai FedML 25 14 0 02 Aug 2021
A General Theory for Client Sampling in Federated Learning Yann Fraboni Richard Vidal Laetitia Kameni Marco Lorenzi FedML 4 13 0 26 Jul 2021
Decentralized Federated Learning: Balancing Communication and Computing Costs Wei Liu Li Chen Wenyi Zhang FedML 19 106 0 26 Jul 2021
RingFed: Reducing Communication Costs in Federated Learning on Non-IID Data Guang Yang Ke Mu Chunhe Song Zhijia Yang Tierui Gong FedML 15 16 0 19 Jul 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 187 412 0 14 Jul 2021
Sparse Personalized Federated Learning Xiaofeng Liu Yinchuan Li Qing Wang Xu Zhang Yunfeng Shao Yanhui Geng FedML 39 6 0 12 Jul 2021
Personalized Federated Learning with Gaussian Processes Idan Achituve Aviv Shamsian Aviv Navon Gal Chechik Ethan Fetaya FedML 32 98 0 29 Jun 2021
Handling Data Heterogeneity with Generative Replay in Collaborative Learning for Medical Imaging Liangqiong Qu N. Balachandar Miao Zhang D. Rubin MedIm 14 19 0 24 Jun 2021
STEM: A Stochastic Two-Sided Momentum Algorithm Achieving Near-Optimal Sample and Communication Complexities for Federated Learning Prashant Khanduri Pranay Sharma Haibo Yang Min-Fong Hong Jia Liu K. Rajawat P. Varshney FedML 19 63 0 19 Jun 2021
Towards Heterogeneous Clients with Elastic Federated Learning Zichen Ma Yu Lu Zihan Lu Wenye Li Jinfeng Yi Shuguang Cui FedML 19 3 0 17 Jun 2021
Decentralized Local Stochastic Extra-Gradient for Variational Inequalities Aleksandr Beznosikov Pavel Dvurechensky Anastasia Koloskova V. Samokhin Sebastian U. Stich Alexander Gasnikov 32 43 0 15 Jun 2021
CRFL: Certifiably Robust Federated Learning against Backdoor Attacks Chulin Xie Minghao Chen Pin-Yu Chen Bo-wen Li FedML 28 164 0 15 Jun 2021
CFedAvg: Achieving Efficient Communication and Fast Convergence in Non-IID Federated Learning Haibo Yang Jia Liu Elizabeth S. Bentley FedML 21 17 0 14 Jun 2021
Communication-efficient SGD: From Local SGD to One-Shot Averaging Artin Spiridonoff Alexander Olshevsky I. Paschalidis FedML 29 20 0 09 Jun 2021
Fast Federated Learning in the Presence of Arbitrary Device Unavailability Xinran Gu Kaixuan Huang Jingzhao Zhang Longbo Huang FedML 27 95 0 08 Jun 2021
SpreadGNN: Serverless Multi-task Federated Learning for Graph Neural Networks Chaoyang He Emir Ceyani Keshav Balasubramanian M. Annavaram Salman Avestimehr FedML 25 50 0 04 Jun 2021
Fast Federated Learning by Balancing Communication Trade-Offs Milad Khademi Nori Sangseok Yun Il Kim FedML 20 53 0 23 May 2021
Joint Optimization of Communications and Federated Learning Over the Air Xin-Yue Fan Yue Wang Yan Huo Z. Tian FedML 6 54 0 08 Apr 2021
1-Bit Compressive Sensing for Efficient Federated Learning Over the Air Xin-Yue Fan Yue Wang Yan Huo Z. Tian FedML 15 33 0 30 Mar 2021
Federated Learning with Taskonomy for Non-IID Data Hadi Jamali Rad Mohammad Abdizadeh Anuj Singh FedML 40 54 0 29 Mar 2021
Hierarchical Federated Learning with Quantization: Convergence Analysis and System Design Lumin Liu Jun Zhang Shenghui Song Khaled B. Letaief FedML 39 79 0 26 Mar 2021
The Gradient Convergence Bound of Federated Multi-Agent Reinforcement Learning with Efficient Communication Xing Xu Rongpeng Li Zhifeng Zhao Honggang Zhang 35 12 0 24 Mar 2021
Personalized Federated Learning using Hypernetworks Aviv Shamsian Aviv Navon Ethan Fetaya Gal Chechik FedML 41 324 0 08 Mar 2021
FedDR -- Randomized Douglas-Rachford Splitting Algorithms for Nonconvex Federated Composite Optimization Quoc Tran-Dinh Nhan H. Pham Dzung Phan Lam M. Nguyen FedML 16 39 0 05 Mar 2021
FedPower: Privacy-Preserving Distributed Eigenspace Estimation Xiaoxun Guo Xiang Li Xiangyu Chang Shusen Wang Zhihua Zhang FedML 16 3 0 01 Mar 2021
Local Stochastic Gradient Descent Ascent: Convergence Analysis and Communication Efficiency Yuyang Deng M. Mahdavi 30 58 0 25 Feb 2021
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients A. Mitra Rayana H. Jaafar George J. Pappas Hamed Hassani FedML 55 157 0 14 Feb 2021
Multi-Tier Federated Learning for Vertically Partitioned Data Anirban Das S. Patterson FedML 13 16 0 06 Feb 2021
Semi-Synchronous Federated Learning for Energy-Efficient Training and Accelerated Convergence in Cross-Silo Settings Dimitris Stripelis J. Ambite FedML 8 38 0 04 Feb 2021
The Min-Max Complexity of Distributed Stochastic Convex Optimization with Intermittent Communication Blake E. Woodworth Brian Bullins Ohad Shamir Nathan Srebro 13 46 0 02 Feb 2021