Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms

22 August 2018

Papers citing "Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms"

50 / 209 papers shown

Title
Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learning Haibo Yang Minghong Fang Jia Liu FedML 17 249 0 27 Jan 2021
Auto-weighted Robust Federated Learning with Corrupted Data Sources Shenghui Li Edith C. H. Ngai Fanghua Ye Thiemo Voigt FedML 19 28 0 14 Jan 2021
Federated Learning over Noisy Channels: Convergence Analysis and Design Examples Xizixiang Wei Cong Shen FedML 36 15 0 06 Jan 2021
CADA: Communication-Adaptive Distributed Adam Tianyi Chen Ziye Guo Yuejiao Sun W. Yin ODL 6 24 0 31 Dec 2020
Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System Heterogeneity Amirhossein Reisizadeh Isidoros Tziotis Hamed Hassani Aryan Mokhtari Ramtin Pedarsani FedML 172 99 0 28 Dec 2020
Federated Multi-Agent Actor-Critic Learning for Age Sensitive Mobile Edge Computing Zheqi Zhu Shuo Wan Pingyi Fan Khaled B. Letaief 11 77 0 28 Dec 2020
Cost-Effective Federated Learning Design Bing Luo Xiang Li Shiqiang Wang Jianwei Huang Leandros Tassiulas FedML 14 177 0 15 Dec 2020
Bandit-based Communication-Efficient Client Selection Strategies for Federated Learning Yae Jee Cho Samarth Gupta Gauri Joshi Osman Yağan FedML 8 67 0 14 Dec 2020
Federated Learning under Importance Sampling Elsa Rizk Stefan Vlaski Ali H. Sayed FedML 16 52 0 14 Dec 2020
Faster Non-Convex Federated Learning via Global and Local Momentum Rudrajit Das Anish Acharya Abolfazl Hashemi Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu FedML 37 82 0 07 Dec 2020
Design and Analysis of Uplink and Downlink Communications for Federated Learning Sihui Zheng Cong Shen Xiang Chen 39 140 0 07 Dec 2020
Second-Order Guarantees in Federated Learning Stefan Vlaski Elsa Rizk Ali H. Sayed FedML 12 7 0 02 Dec 2020
On the Benefits of Multiple Gossip Steps in Communication-Constrained Decentralized Optimization Abolfazl Hashemi Anish Acharya Rudrajit Das H. Vikalo Sujay Sanghavi Inderjit Dhillon 20 7 0 20 Nov 2020
Federated Composite Optimization Honglin Yuan Manzil Zaheer Sashank J. Reddi FedML 32 58 0 17 Nov 2020
Distributed Sparse SGD with Majority Voting Kerem Ozfatura Emre Ozfatura Deniz Gunduz FedML 38 4 0 12 Nov 2020
Communication-efficient Decentralized Local SGD over Undirected Networks Tiancheng Qin S. Rasoul Etesami César A. Uribe FedML 19 14 0 06 Nov 2020
A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! D. Kovalev Anastasia Koloskova Martin Jaggi Peter Richtárik Sebastian U. Stich 15 73 0 03 Nov 2020
Demystifying Why Local Aggregation Helps: Convergence Analysis of Hierarchical SGD Jiayi Wang Shiqiang Wang Rong-Rong Chen Mingyue Ji FedML 36 51 0 24 Oct 2020
Throughput-Optimal Topology Design for Cross-Silo Federated Learning Othmane Marfoq Chuan Xu Giovanni Neglia Richard Vidal FedML 67 85 0 23 Oct 2020
Decentralized Deep Learning using Momentum-Accelerated Consensus Aditya Balu Zhanhong Jiang Sin Yong Tan Chinmay Hedge Young M. Lee S. Sarkar FedML 24 22 0 21 Oct 2020
FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous Tiers Zheng Chai Yujing Chen Ali Anwar Liang Zhao Yue Cheng Huzefa Rangwala FedML 21 121 0 12 Oct 2020
A Closer Look at Codistillation for Distributed Training Shagun Sodhani Olivier Delalleau Mahmoud Assran Koustuv Sinha Nicolas Ballas Michael G. Rabbat 19 8 0 06 Oct 2020
Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategies Yae Jee Cho Jianyu Wang Gauri Joshi FedML 33 400 0 03 Oct 2020
Federated Learning with Nesterov Accelerated Gradient Zhengjie Yang Wei Bao Dong Yuan Nguyen H. Tran Albert Y. Zomaya FedML 19 29 0 18 Sep 2020
POSEIDON: Privacy-Preserving Federated Neural Network Learning Sinem Sav Apostolos Pyrgelis J. Troncoso-Pastoriza D. Froelicher Jean-Philippe Bossuat João Sá Sousa Jean-Pierre Hubaux FedML 11 153 0 01 Sep 2020
FedSKETCH: Communication-Efficient and Private Federated Learning via Sketching Farzin Haddadpour Belhal Karimi Ping Li Xiaoyun Li FedML 50 31 0 11 Aug 2020
Multi-Level Local SGD for Heterogeneous Hierarchical Networks Timothy Castiglia Anirban Das S. Patterson 18 13 0 27 Jul 2020
CSER: Communication-efficient SGD with Error Reset Cong Xie Shuai Zheng Oluwasanmi Koyejo Indranil Gupta Mu Li Yanghua Peng 19 41 0 26 Jul 2020
Fast-Convergent Federated Learning Hung T. Nguyen Vikash Sehwag Seyyedali Hosseinalipour Christopher G. Brinton M. Chiang H. Vincent Poor FedML 26 192 0 26 Jul 2020
FetchSGD: Communication-Efficient Federated Learning with Sketching D. Rothchild Ashwinee Panda Enayat Ullah Nikita Ivkin Ion Stoica Vladimir Braverman Joseph E. Gonzalez Raman Arora FedML 17 361 0 15 Jul 2020
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization Jianyu Wang Qinghua Liu Hao Liang Gauri Joshi H. Vincent Poor MoMe FedML 16 1,297 0 15 Jul 2020
VAFL: a Method of Vertical Asynchronous Federated Learning Tianyi Chen Xiao Jin Yuejiao Sun W. Yin FedML 7 159 0 12 Jul 2020
Federated Learning with Compression: Unified Analysis and Sharp Guarantees Farzin Haddadpour Mohammad Mahdi Kamani Aryan Mokhtari M. Mahdavi FedML 33 271 0 02 Jul 2020
On the Outsized Importance of Learning Rates in Local Update Methods Zachary B. Charles Jakub Konecný FedML 19 54 0 02 Jul 2020
DEED: A General Quantization Scheme for Communication Efficiency in Bits Tian-Chun Ye Peijun Xiao Ruoyu Sun FedML MQ 28 2 0 19 Jun 2020
Federated Learning With Quantized Global Model Updates M. Amiri Deniz Gunduz Sanjeev R. Kulkarni H. Vincent Poor FedML 16 130 0 18 Jun 2020
Federated Accelerated Stochastic Gradient Descent Honglin Yuan Tengyu Ma FedML 17 171 0 16 Jun 2020
Personalized Federated Learning with Moreau Envelopes Canh T. Dinh N. H. Tran Tuan Dung Nguyen FedML 39 966 0 16 Jun 2020
Optimal Complexity in Decentralized Training Yucheng Lu Christopher De Sa 38 72 0 15 Jun 2020
FedGAN: Federated Generative Adversarial Networks for Distributed Data M. Rasouli Tao Sun Ram Rajagopal FedML 21 143 0 12 Jun 2020
STL-SGD: Speeding Up Local SGD with Stagewise Communication Period Shuheng Shen Yifei Cheng Jingchang Liu Linli Xu LRM 21 7 0 11 Jun 2020
Minibatch vs Local SGD for Heterogeneous Distributed Learning Blake E. Woodworth Kumar Kshitij Patel Nathan Srebro FedML 22 199 0 08 Jun 2020
Local SGD With a Communication Overhead Depending Only on the Number of Workers Artin Spiridonoff Alexander Olshevsky I. Paschalidis FedML 25 19 0 03 Jun 2020
DaSGD: Squeezing SGD Parallelization Performance in Distributed Training Using Delayed Averaging Q. Zhou Yawen Zhang Pengcheng Li Xiaoyong Liu Jun Yang Runsheng Wang Ru Huang FedML 19 2 0 31 May 2020
FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data Xinwei Zhang Mingyi Hong S. Dhople W. Yin Yang Liu FedML 21 227 0 22 May 2020
Scalable Privacy-Preserving Distributed Learning D. Froelicher J. Troncoso-Pastoriza Apostolos Pyrgelis Sinem Sav João Sá Sousa Jean-Philippe Bossuat Jean-Pierre Hubaux FedML 14 68 0 19 May 2020
MixML: A Unified Analysis of Weakly Consistent Parallel Learning Yucheng Lu J. Nash Christopher De Sa FedML 32 12 0 14 May 2020
Communication-Efficient Distributed Stochastic AUC Maximization with Deep Neural Networks Zhishuai Guo Mingrui Liu Zhuoning Yuan Li Shen Wei Liu Tianbao Yang 33 42 0 05 May 2020
Distributed Stochastic Non-Convex Optimization: Momentum-Based Variance Reduction Prashant Khanduri Pranay Sharma Swatantra Kafle Saikiran Bulusu K. Rajawat P. Varshney 17 6 0 01 May 2020
Concentrated Differentially Private and Utility Preserving Federated Learning Rui Hu Yuanxiong Guo Yanmin Gong FedML 30 12 0 30 Mar 2020