Distributed Training of Deep Learning Models: A Taxonomic Perspective

Distributed Training of Deep Learning Models: A Taxonomic Perspective

8 July 2020

Papers citing "Distributed Training of Deep Learning Models: A Taxonomic Perspective"

16 / 16 papers shown

Title
Dyn-D $^2$ P: Dynamic Differentially Private Decentralized Learning with Provable Utility Guarantee Zehan Zhu Yan Huang Xin Wang Shouling Ji Jinming Xu 26 0 0 10 May 2025
Efficient Split Learning LSTM Models for FPGA-based Edge IoT Devices Romina Soledad Molina Vukan Ninkovic D. Vukobratović Maria Liz Crespo Marco Zennaro 45 0 0 12 Feb 2025
ReDistill: Residual Encoded Distillation for Peak Memory Reduction of CNNs Fang Chen Gourav Datta Mujahid Al Rafi Hyeran Jeon Meng Tang 93 1 0 06 Jun 2024
PrivSGP-VR: Differentially Private Variance-Reduced Stochastic Gradient Push with Tight Utility Bounds Zehan Zhu Yan Huang Xin Wang Jinming Xu 49 0 0 04 May 2024
Robust Fully-Asynchronous Methods for Distributed Training over General Architecture Zehan Zhu Ye Tian Yan Huang Jinming Xu Shibo He OOD 27 2 0 21 Jul 2023
Proof of Training (PoT): Harnessing Crypto Mining Power for Distributed AI Training Peihao Li 20 2 0 13 Jul 2023
A Survey From Distributed Machine Learning to Distributed Deep Learning Mohammad Dehghani Zahra Yazdanparast 26 0 0 11 Jul 2023
Distributed Graph Neural Network Training: A Survey Yingxia Shao Hongzheng Li Xizhi Gu Hongbo Yin Yawen Li Xupeng Miao Wentao Zhang Bin Cui Lei Chen GNN AI4CE 13 56 0 01 Nov 2022
Merlin HugeCTR: GPU-accelerated Recommender System Training and Inference Zehuan Wang Yingcan Wei Minseok Lee Matthias Langer F. Yu ... Daniel G. Abel Xu Guo Jianbing Dong Ji Shi Kunlun Li GNN LRM 25 32 0 17 Oct 2022
Communication-Efficient Federated Learning for Neural Machine Translation Tanya Roosta Peyman Passban Ankit R. Chadha FedML AI4CE 27 5 0 12 Dec 2021
Federated learning and next generation wireless communications: A survey on bidirectional relationship Debaditya Shome Omer Waqar Wali Ullah Khan 41 31 0 14 Oct 2021
Productivity, Portability, Performance: Data-Centric Python Yiheng Wang Yao Zhang Yanzhang Wang Yan Wan Jiao Wang Zhongyuan Wu Yuhao Yang Bowen She 54 95 0 01 Jul 2021
Randomness In Neural Network Training: Characterizing The Impact of Tooling Donglin Zhuang Xingyao Zhang Shuaiwen Leon Song Sara Hooker 25 75 0 22 Jun 2021
Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligence Emna Baccour N. Mhaisen A. Abdellatif A. Erbad Amr M. Mohamed Mounir Hamdi Mohsen Guizani 30 86 0 04 May 2021
Unleashing the Tiger: Inference Attacks on Split Learning Dario Pasquini G. Ateniese M. Bernaschi FedML 34 147 0 04 Dec 2020
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,892 0 15 Sep 2016