GossipGraD: Scalable Deep Learning using Gossip Communication based Asynchronous Gradient Descent

15 March 2018

Papers citing "GossipGraD: Scalable Deep Learning using Gossip Communication based Asynchronous Gradient Descent"

32 / 32 papers shown

Title
Re-Evaluating Privacy in Centralized and Decentralized Learning: An Information-Theoretical and Empirical Study Changlong Ji Stephane Maag Richard Heusdens Qiongxiu Li FedML 61 2 0 21 Sep 2024
Decentralized Graph Neural Network for Privacy-Preserving Recommendation Xiaolin Zheng Zhongyu Wang Chaochao Chen Jiashu Qian Yao Yang FedML 63 8 0 15 Aug 2023
$$\textbf{A}^2\textbf{CiD}^2$: Accelerating Asynchronous Communication in Decentralized Deep Learning$ $\textbf{A}^2\textbf{CiD}^2$ : Accelerating Asynchronous Communication in Decentralized Deep Learning Adel Nabli Eugene Belilovsky Edouard Oyallon 74 7 0 14 Jun 2023
On the Limit Performance of Floating Gossip Gianluca Rizzo Noelia Pérez Palma M. Marsan Vincenzo Mancuso FedML 46 0 0 16 Feb 2023
FLAGS Framework for Comparative Analysis of Federated Learning Algorithms Ahnaf Hannan Lodhi Barış Akgün Öznur Özkasap FedML 38 4 0 14 Dec 2022
Lessons Learned on MPI+Threads Communication Rohit Zambre Aparna Chandramowlishwaran 21 6 0 28 Jun 2022
Autonomy and Intelligence in the Computing Continuum: Challenges, Enablers, and Future Directions for Orchestration Henna Kokkonen Lauri Lovén Naser Hossein Motlagh Abhishek Kumar Juha Partala ... M. Bennis Sasu Tarkoma Schahram Dustdar Susanna Pirttikangas J. Riekki 99 27 0 03 May 2022
Secure Distributed/Federated Learning: Prediction-Privacy Trade-Off for Multi-Agent System Mohamed Ridha Znaidi Gaurav Gupta P. Bogdan FedML 40 1 0 24 Apr 2022
Scatterbrained: A flexible and expandable pattern for decentralized machine learning Miller Wilt Jordan K Matelsky A. Gearhart FedML OOD 56 4 0 14 Dec 2021
p2pGNN: A Decentralized Graph Neural Network for Node Classification in Peer-to-Peer Networks Emmanouil Krasanakis Symeon Papadopoulos I. Kompatsiaris GNN 52 7 0 29 Nov 2021
DACFL: Dynamic Average Consensus Based Federated Learning in Decentralized Topology Zhikun Chen Daofeng Li Jinkang Zhu Sihai Zhang FedML 119 10 0 10 Nov 2021
DeceFL: A Principled Decentralized Federated Learning Framework Ye Yuan Jun Liu Dou Jin Zuogong Yue Ruijuan Chen ... Xinlei Yi Tao Yang Hai-Tao Zhang Shaochun Sui Han Ding FedML 73 11 0 15 Jul 2021
EventGraD: Event-Triggered Communication in Parallel Machine Learning Soumyadip Ghosh B. Aquino V. Gupta FedML 94 9 0 12 Mar 2021
Detection of Insider Attacks in Distributed Projected Subgradient Algorithms Sissi Xiaoxiao Wu Gangqiang Li Shengli Zhang Xiaohui Lin AAML 51 3 0 18 Jan 2021
Opportunities of Federated Learning in Connected, Cooperative and Automated Industrial Systems S. Savazzi M. Nicoli M. Bennis Sanaz Kianoush Luca Barbieri FedML AIFin AI4CE 106 128 0 09 Jan 2021
Crossover-SGD: A gossip-based communication in distributed deep learning for alleviating large mini-batch problem and enhancing scalability Sangho Yeo Minho Bae Minjoong Jeong Oh-Kyoung Kwon Sangyoon Oh 57 3 0 30 Dec 2020
Optimising cost vs accuracy of decentralised analytics in fog computing environments Lorenzo Valerio A. Passarella M. Conti 69 1 0 09 Dec 2020
Privacy Preservation in Federated Learning: An insightful survey from the GDPR Perspective N. Truong Kai Sun Siyao Wang Florian Guitton Yike Guo FedML 65 9 0 10 Nov 2020
State-of-the-art Techniques in Deep Edge Intelligence Ahnaf Hannan Lodhi Barış Akgün Öznur Özkasap 41 5 0 03 Aug 2020
Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging Shigang Li Tal Ben-Nun Giorgi Nadiradze Salvatore Di Girolamo Nikoli Dryden Dan Alistarh Torsten Hoefler 75 15 0 30 Apr 2020
A Review of Privacy-preserving Federated Learning for the Internet-of-Things Christopher Briggs Zhong Fan Péter András 129 15 0 24 Apr 2020
Communication-Efficient Distributed Deep Learning: A Comprehensive Survey Zhenheng Tang Shaoshuai Shi Wei Wang Yue Liu Xiaowen Chu 80 49 0 10 Mar 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 99 334 0 22 Feb 2020
Distributed Learning in the Non-Convex World: From Batch to Streaming Data, and Beyond Tsung-Hui Chang Mingyi Hong Hoi-To Wai Xinwei Zhang Songtao Lu GNN 63 13 0 14 Jan 2020
Federated Learning with Cooperating Devices: A Consensus Approach for Massive IoT Networks S. Savazzi M. Nicoli V. Rampa FedML 72 311 0 27 Dec 2019
Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence Shuiguang Deng Hailiang Zhao Weijia Fang Yuxiang Cai Schahram Dustdar Albert Y. Zomaya 104 618 0 02 Sep 2019
Decentralized Federated Learning: A Segmented Gossip Approach Chenghao Hu Jingyan Jiang Zhi Wang FedML 71 187 0 21 Aug 2019
Taming Unbalanced Training Workloads in Deep Learning with Partial Collective Operations Shigang Li Tal Ben-Nun Salvatore Di Girolamo Dan Alistarh Torsten Hoefler 147 59 0 12 Aug 2019
Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing Zhi Zhou Xu Chen En Li Liekang Zeng Ke Luo Junshan Zhang 105 1,448 0 24 May 2019
Priority-based Parameter Propagation for Distributed DNN Training Anand Jayarajan Jinliang Wei Garth A. Gibson Alexandra Fedorova Gennady Pekhimenko AI4CE 62 182 0 10 May 2019
Distributed Learning over Unreliable Networks Chen Yu Hanlin Tang Cédric Renggli S. Kassing Ankit Singla Dan Alistarh Ce Zhang Ji Liu OOD 105 61 0 17 Oct 2018
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis Tal Ben-Nun Torsten Hoefler GNN 82 711 0 26 Feb 2018