Collaborative Deep Learning in Fixed Topology Networks

23 June 2017

Aditya Balu

Papers citing "Collaborative Deep Learning in Fixed Topology Networks"

39 / 39 papers shown

Title
A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration Yuchen Hu Xi Chen Weidong Liu Xiaojun Mao 57 0 0 31 Jan 2025
Distributed Sign Momentum with Local Steps for Training Transformers Shuhua Yu Ding Zhou Cong Xie An Xu Zhi-Li Zhang Xin Liu S. Kar 69 0 0 26 Nov 2024
DIMAT: Decentralized Iterative Merging-And-Training for Deep Learning Models Nastaran Saadati Minh Pham Nasla Saleem Joshua R. Waite Aditya Balu Zhanhong Jiang Chinmay Hegde Soumik Sarkar MoMe 47 1 0 11 Apr 2024
Peer-to-Peer Learning + Consensus with Non-IID Data Srinivasa Pranav José M. F. Moura 13 3 0 21 Dec 2023
DropCompute: simple and more robust distributed synchronous training via compute variance reduction Niv Giladi Shahar Gottlieb Moran Shkolnik A. Karnieli Ron Banner Elad Hoffer Kfir Y. Levy Daniel Soudry 33 2 0 18 Jun 2023
Structured Cooperative Learning with Graphical Model Priors Shuang-Yang Li Dinesh Manocha Xinmei Tian Dacheng Tao 38 0 0 16 Jun 2023
Failure-tolerant Distributed Learning for Anomaly Detection in Wireless Networks Marc Katzef Andrew C. Cullen T. Alpcan C. Leckie Justin Kopacz 25 0 0 23 Mar 2023
PRECISION: Decentralized Constrained Min-Max Learning with Low Communication and Sample Complexities Zhuqing Liu Xin Zhang Songtao Lu Jia-Wei Liu 40 7 0 05 Mar 2023
Decentralized Nonconvex Optimization with Guaranteed Privacy and Accuracy Yongqiang Wang Tamer Basar 21 21 0 14 Dec 2022
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming Parvin Nazari Ahmad Mousavi Davoud Ataee Tarzanagh George Michailidis 31 4 0 08 Nov 2022
STSyn: Speeding Up Local SGD with Straggler-Tolerant Synchronization Feng Zhu Jingjing Zhang Xin Wang 33 3 0 06 Oct 2022
Distributed Online Non-convex Optimization with Composite Regret Zhanhong Jiang Aditya Balu Xian Yeow Lee Young M. Lee C. Hegde S. Sarkar 41 4 0 21 Sep 2022
On Generalization of Decentralized Learning with Separable Data Hossein Taheri Christos Thrampoulidis FedML 30 11 0 15 Sep 2022
INTERACT: Achieving Low Sample and Communication Complexities in Decentralized Bilevel Learning over Networks Zhuqing Liu Xin Zhang Prashant Khanduri Songtao Lu Jia Liu 35 11 0 27 Jul 2022
Confederated Learning: Federated Learning with Decentralized Edge Servers Bin Wang Jun Fang Hongbin Li Xiaojun Yuan Qing Ling FedML 26 23 0 30 May 2022
Semi-Decentralized Federated Learning with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 42 32 0 23 May 2022
Collaborative Learning for Hand and Object Reconstruction with Attention-guided Graph Convolution Tze Ho Elden Tse K. Kim A. Leonardis H. Chang 3DH 19 57 0 27 Apr 2022
Robust Federated Learning with Connectivity Failures: A Semi-Decentralized Framework with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 45 8 0 24 Feb 2022
Scatterbrained: A flexible and expandable pattern for decentralized machine learning Miller Wilt Jordan K Matelsky A. Gearhart FedML OOD 24 4 0 14 Dec 2021
Collaborative Learning over Wireless Networks: An Introductory Overview Emre Ozfatura Deniz Gunduz H. Vincent Poor 27 11 0 07 Dec 2021
A Unified and Refined Convergence Analysis for Non-Convex Decentralized Learning Sulaiman A. Alghunaim Kun Yuan 28 57 0 19 Oct 2021
Decentralized Federated Learning: Balancing Communication and Computing Costs Wei Liu Li Chen Wenyi Zhang FedML 19 106 0 26 Jul 2021
A Decentralized Adaptive Momentum Method for Solving a Class of Min-Max Optimization Problems Babak Barazandeh Tianjian Huang George Michailidis 27 12 0 10 Jun 2021
SpreadGNN: Serverless Multi-task Federated Learning for Graph Neural Networks Chaoyang He Emir Ceyani Keshav Balasubramanian M. Annavaram Salman Avestimehr FedML 25 50 0 04 Jun 2021
Consistent Lock-free Parallel Stochastic Gradient Descent for Fast and Stable Convergence Karl Bäckström Ivan Walulya Marina Papatriantafilou P. Tsigas 29 5 0 17 Feb 2021
Consensus Control for Decentralized Deep Learning Lingjing Kong Tao R. Lin Anastasia Koloskova Martin Jaggi Sebastian U. Stich 19 76 0 09 Feb 2021
Understanding Training Efficiency of Deep Learning Recommendation Models at Scale Bilge Acun Matthew Murphy Xiaodong Wang Jade Nie Carole-Jean Wu K. Hazelwood 36 109 0 11 Nov 2020
Throughput-Optimal Topology Design for Cross-Silo Federated Learning Othmane Marfoq Chuan Xu Giovanni Neglia Richard Vidal FedML 67 85 0 23 Oct 2020
On the Convergence of Local Descent Methods in Federated Learning Farzin Haddadpour M. Mahdavi FedML 19 266 0 31 Oct 2019
Communication-Efficient Local Decentralized SGD Methods Xiang Li Wenhao Yang Shusen Wang Zhihua Zhang 30 53 0 21 Oct 2019
Robust and Communication-Efficient Collaborative Learning Amirhossein Reisizadeh Hossein Taheri Aryan Mokhtari Hamed Hassani Ramtin Pedarsani 25 89 0 24 Jul 2019
Decentralized Bayesian Learning over Graphs Anusha Lalitha Xinghan Wang O. Kilinc Y. Lu T. Javidi F. Koushanfar FedML 28 25 0 24 May 2019
Decentralized Learning of Generative Adversarial Networks from Non-iid Data Ryo Yonetani Tomohiro Takahashi Atsushi Hashimoto Yoshitaka Ushiku 45 24 0 23 May 2019
MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling Jianyu Wang Anit Kumar Sahu Zhouyi Yang Gauri Joshi S. Kar 29 159 0 23 May 2019
Wireless Network Intelligence at the Edge Jihong Park S. Samarakoon M. Bennis Mérouane Debbah 21 518 0 07 Dec 2018
Adaptive Communication Strategies to Achieve the Best Error-Runtime Trade-off in Local-Update SGD Jianyu Wang Gauri Joshi FedML 33 231 0 19 Oct 2018
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms Jianyu Wang Gauri Joshi 33 348 0 22 Aug 2018
Efficient Decentralized Deep Learning by Dynamic Model Averaging Michael Kamp Linara Adilova Joachim Sicking Fabian Hüger Peter Schlicht Tim Wirtz Stefan Wrobel 32 129 0 09 Jul 2018
Defending Against Saddle Point Attack in Byzantine-Robust Distributed Learning Dong Yin Yudong Chen Kannan Ramchandran Peter L. Bartlett FedML 29 97 0 14 Jun 2018