Horovod: fast and easy distributed deep learning in TensorFlow

15 February 2018

Papers citing "Horovod: fast and easy distributed deep learning in TensorFlow"

24 / 174 papers shown

Title
Faster Distributed Deep Net Training: Computation and Communication Decoupled Stochastic Gradient Descent Shuheng Shen Linli Xu Jingchang Liu Xianfeng Liang Yifei Cheng ODL FedML 29 24 0 28 Jun 2019
Fully Decoupled Neural Network Learning Using Delayed Gradients Huiping Zhuang Yi Wang Qinglai Liu Shuai Zhang Zhiping Lin FedML 25 30 0 21 Jun 2019
Deep Leakage from Gradients Ligeng Zhu Zhijian Liu Song Han FedML 43 2,163 0 21 Jun 2019
Predicting Motion of Vulnerable Road Users using High-Definition Maps and Efficient ConvNets Fang-Chieh Chou Tsung-Han Lin Henggang Cui Vladan Radosavljevic Thi Nguyen Tzu-Kuo Huang Matthew Niedoba J. Schneider Nemanja Djuric 10 58 0 20 Jun 2019
Margin Matters: Towards More Discriminative Deep Neural Network Embeddings for Speaker Recognition Xu Xiang Shuai Wang Houjun Huang Y. Qian Kai Yu DRL 24 142 0 18 Jun 2019
Layered SGD: A Decentralized and Synchronous SGD Algorithm for Scalable Deep Neural Network Training K. Yu Thomas Flynn Shinjae Yoo N. DÍmperio OffRL 24 6 0 13 Jun 2019
Precipitation Nowcasting with Satellite Imagery V. Lebedev V. Ivashkin Irina Rudenko A. Ganshin A. Molchanov Sergey Ovcharenko Ruslan Grokhovetskiy Ivan Bushmarinov D. Solomentsev AI4Cl 22 70 0 23 May 2019
Scaling Distributed Training of Flood-Filling Networks on HPC Infrastructure for Brain Mapping Wu Dong Murat Keçeli Rafael Vescovi Hanyu Li Corey Adams ... T. Uram V. Vishwanath N. Ferrier B. Kasthuri P. Littlewood FedML AI4CE 22 9 0 13 May 2019
Deep Fusion Network for Image Completion Xin Hong Pengfei Xiong Renhe Ji Haoqiang Fan 3DV 27 94 0 17 Apr 2019
ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed data F. Diakogiannis F. Waldner P. Caccetta Chen Wu SSeg 38 1,285 0 01 Apr 2019
TF-Replicator: Distributed Machine Learning for Researchers P. Buchlovsky David Budden Dominik Grewe Chris Jones John Aslanides ... Aidan Clark Sergio Gomez Colmenarejo Aedan Pope Fabio Viola Dan Belov GNN OffRL AI4CE 37 20 0 01 Feb 2019
Augment your batch: better training with larger batches Elad Hoffer Tal Ben-Nun Itay Hubara Niv Giladi Torsten Hoefler Daniel Soudry ODL 30 72 0 27 Jan 2019
A Distributed Synchronous SGD Algorithm with Global Top- $k$ Sparsification for Low Bandwidth Networks Shaoshuai Shi Qiang-qiang Wang Kaiyong Zhao Zhenheng Tang Yuxin Wang Xiang Huang Xuming Hu 40 135 0 14 Jan 2019
CROSSBOW: Scaling Deep Learning with Small Batch Sizes on Multi-GPU Servers A. Koliousis Pijika Watcharapichat Matthias Weidlich Luo Mai Paolo Costa Peter R. Pietzuch 32 69 0 08 Jan 2019
A Simple Non-i.i.d. Sampling Approach for Efficient Training and Better Generalization Bowen Cheng Yunchao Wei Jiahui Yu Shiyu Chang Jinjun Xiong Wen-mei W. Hwu Thomas S. Huang Humphrey Shi OOD VLM 38 6 0 23 Nov 2018
Workload-aware Automatic Parallelization for Multi-GPU DNN Training Sungho Shin Y. Jo Jungwook Choi Swagath Venkataramani Vijayalakshmi Srinivasan Wonyong Sung 3DH 19 1 0 05 Nov 2018
A Hitchhiker's Guide On Distributed Training of Deep Neural Networks K. Chahal Manraj Singh Grover Kuntal Dey 3DH OOD 6 53 0 28 Oct 2018
Scalable Distributed DNN Training using TensorFlow and CUDA-Aware MPI: Characterization, Designs, and Performance Evaluation A. A. Awan Jeroen Bédorf Ching-Hsiang Chu Hari Subramoni D. Panda GNN 33 45 0 25 Oct 2018
RLgraph: Modular Computation Graphs for Deep Reinforcement Learning Michael Schaarschmidt Sven Mika Kai Fricke Eiko Yoneki OffRL 23 5 0 21 Oct 2018
Fault Tolerance in Iterative-Convergent Machine Learning Aurick Qiao Bryon Aragam Bingjing Zhang Eric Xing 26 41 0 17 Oct 2018
GPU-Accelerated Robotic Simulation for Distributed Reinforcement Learning Jacky Liang Viktor Makoviychuk Ankur Handa N. Chentanez Miles Macklin Dieter Fox AI4CE 27 182 0 12 Oct 2018
Exascale Deep Learning for Climate Analytics Thorsten Kurth Sean Treichler Josh Romero M. Mudigonda Nathan Luehr ... Michael A. Matheson J. Deslippe M. Fatica P. Prabhat Michael Houston BDL 17 260 0 03 Oct 2018
Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Driving Nemanja Djuric Vladan Radosavljevic Henggang Cui Thi Nguyen Fang-Chieh Chou Tsung-Han Lin Nitin Singh J. Schneider 46 206 0 17 Aug 2018
Analysis of DAWNBench, a Time-to-Accuracy Machine Learning Performance Benchmark Cody Coleman Daniel Kang Deepak Narayanan Luigi Nardi Tian Zhao Jian Zhang Peter Bailis K. Olukotun Christopher Ré Matei A. Zaharia 13 117 0 04 Jun 2018