A DAG Model of Synchronous Stochastic Gradient Descent in Distributed
Deep Learning

A DAG Model of Synchronous Stochastic Gradient Descent in Distributed Deep Learning

10 May 2018

Qiang-qiang Wang

Papers citing "A DAG Model of Synchronous Stochastic Gradient Descent in Distributed Deep Learning"

15 / 15 papers shown

Title
Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs Shaoshuai Shi Qiang-qiang Wang Xiaowen Chu 52 110 0 16 Nov 2017
Stochastic Nonconvex Optimization with Large Minibatches Weiran Wang Nathan Srebro 54 26 0 25 Sep 2017
ImageNet Training in Minutes Yang You Zhao-jie Zhang Cho-Jui Hsieh J. Demmel Kurt Keutzer VLM LRM 42 57 0 14 Sep 2017
Distributed Training Large-Scale Deep Architectures Shang-Xuan Zou Chun-Yen Chen Jui-Lin Wu Chun-Nan Chou Chia-Chin Tsao Kuan-Chieh Tung Ting-Wei Lin Cheng-Lung Sung Edward Y. Chang 30 22 0 10 Aug 2017
Optimized Broadcast for Deep Learning Workloads on Dense-GPU InfiniBand Clusters: MPI or NCCL? A. A. Awan Ching-Hsiang Chu Hari Subramoni D. Panda GNN 56 46 0 28 Jul 2017
Poseidon: An Efficient Communication Architecture for Distributed Deep Learning on GPU Clusters Huatian Zhang Zeyu Zheng Shizhen Xu Wei-Ming Dai Qirong Ho Xiaodan Liang Zhiting Hu Jinliang Wei P. Xie Eric Xing GNN 47 343 0 11 Jun 2017
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour Priya Goyal Piotr Dollár Ross B. Girshick P. Noordhuis Lukasz Wesolowski Aapo Kyrola Andrew Tulloch Yangqing Jia Kaiming He 3DH 75 3,666 0 08 Jun 2017
Benchmarking State-of-the-Art Deep Learning Software Tools Shaoshuai Shi Qiang-qiang Wang Pengfei Xu Xiaowen Chu BDL 36 329 0 25 Aug 2016
Revisiting Distributed Synchronous SGD Jianmin Chen Xinghao Pan R. Monga Samy Bengio Rafal Jozefowicz 53 799 0 04 Apr 2016
Distributed Deep Learning Using Synchronous Stochastic Gradient Descent Dipankar Das Sasikanth Avancha Dheevatsa Mudigere K. Vaidyanathan Srinivas Sridharan Dhiraj D. Kalamkar Bharat Kaul Pradeep Dubey GNN 43 170 0 22 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.2K 192,638 0 10 Dec 2015
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems Tianqi Chen Mu Li Yutian Li Min Lin Naiyan Wang Minjie Wang Tianjun Xiao Bing Xu Chiyuan Zhang Zheng Zhang 95 2,243 0 03 Dec 2015
Comparative Study of Deep Learning Software Frameworks S. Bahrampour Naveen Ramakrishnan Lukas Schott Mohak Shah 43 161 0 19 Nov 2015
cuDNN: Efficient Primitives for Deep Learning Sharan Chetlur Cliff Woolley Philippe Vandermersch Jonathan M. Cohen J. Tran Bryan Catanzaro Evan Shelhamer 79 1,844 0 03 Oct 2014
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 269 43,511 0 17 Sep 2014