Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques and Tools

27 March 2019

Papers citing "Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques and Tools"

23 / 23 papers shown

Title
Onboard Optimization and Learning: A Survey Monirul Islam Pavel Siyi Hu Mahardhika Pratama Ryszard Kowalczyk 26 0 0 07 May 2025
Acceleration for Deep Reinforcement Learning using Parallel and Distributed Computing: A Survey Zhihong Liu Xin Xu Peng Qiao Dongsheng Li OffRL 22 2 0 08 Nov 2024
Going Forward-Forward in Distributed Deep Learning Ege Aktemur Ege Zorlutuna Kaan Bilgili Tacettin Emre Bok Berrin Yanikoglu Suha Orhun Mutluergil FedML 23 1 0 30 Mar 2024
PipeOptim: Ensuring Effective 1F1B Schedule with Optimizer-Dependent Weight Prediction Lei Guan Dongsheng Li Jiye Liang Wenjian Wang Wenjian Wang Xicheng Lu 37 1 0 01 Dec 2023
Convergence Analysis of Decentralized ASGD Mauro Dalle Lucca Tosi Martin Theobald 29 2 0 07 Sep 2023
A Survey From Distributed Machine Learning to Distributed Deep Learning Mohammad Dehghani Zahra Yazdanparast 23 0 0 11 Jul 2023
The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Survey Jana Vatter R. Mayer Hans-Arno Jacobsen GNN AI4TS AI4CE 48 23 0 23 May 2023
Taming Resource Heterogeneity In Distributed ML Training With Dynamic Batching S. Tyagi Prateek Sharma 21 22 0 20 May 2023
Containerisation for High Performance Computing Systems: Survey and Prospects Naweiluo Zhou Huan Zhou Dennis Hoppe 35 25 0 16 Dec 2022
Joint Optimization of Energy Consumption and Completion Time in Federated Learning Xinyu Zhou Jun Zhao Huimei Han C. Guet FedML 48 27 0 29 Sep 2022
Implicit Channel Learning for Machine Learning Applications in 6G Wireless Networks Ahmet M. Elbir W. Shi Kumar Vijay Mishra Anastasios K. Papazafeiropoulos Symeon Chatzinotas 17 3 0 24 Jun 2022
Taking ROCKET on an Efficiency Mission: Multivariate Time Series Classification with LightWaveS Leonardos Pantiskas K. Verstoep Mark Hoogendoorn Henri E. Bal 34 6 0 04 Apr 2022
Optimising Communication Overhead in Federated Learning Using NSGA-II José Á. Morell Z. Dahi Francisco Chicano Gabriel Luque Enrique Alba FedML 30 11 0 01 Apr 2022
ACE: Towards Application-Centric Edge-Cloud Collaborative Intelligence Luhui Wang Cong Zhao Shusen Yang Xinyu Yang Julie McCann 25 1 0 24 Mar 2022
Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines Alexander Isenko R. Mayer Jeffrey Jedele Hans-Arno Jacobsen 19 23 0 17 Feb 2022
BAGUA: Scaling up Distributed Learning with System Relaxations Shaoduo Gan Xiangru Lian Rui Wang Jianbin Chang Chengjun Liu ... Jiawei Jiang Binhang Yuan Sen Yang Ji Liu Ce Zhang 23 30 0 03 Jul 2021
Video Big Data Analytics in the Cloud: A Reference Architecture, Survey, Opportunities, and Open Research Issues A. Alam I. Ullah Young-Koo Lee 42 22 0 16 Nov 2020
Communication optimization strategies for distributed deep neural network training: A survey Shuo Ouyang Dezun Dong Yemao Xu Liquan Xiao 30 12 0 06 Mar 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 17 326 0 22 Feb 2020
Characterizing Deep Learning Training Workloads on Alibaba-PAI Mengdi Wang Chen Meng Guoping Long Chuan Wu Jun Yang Wei Lin Yangqing Jia 17 53 0 14 Oct 2019
A Survey on Deep Learning in Medical Image Analysis G. Litjens Thijs Kooi B. Bejnordi A. Setio F. Ciompi Mohsen Ghafoorian Jeroen van der Laak Bram van Ginneken C. I. Sánchez OOD 307 10,621 0 19 Feb 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,327 0 05 Nov 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,746 0 26 Sep 2016