How to scale distributed deep learning?

14 November 2016

Papers citing "How to scale distributed deep learning?"

10 / 60 papers shown

Title
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms Jianyu Wang Gauri Joshi 30 348 0 22 Aug 2018
Newton-ADMM: A Distributed GPU-Accelerated Optimizer for Multiclass Classification Problems Chih-Hao Fang Sudhir B. Kylasa Fred Roosta Michael W. Mahoney A. Grama ODL 14 10 0 18 Jul 2018
On Consensus-Optimality Trade-offs in Collaborative Deep Learning Zhanhong Jiang Aditya Balu C. Hegde S. Sarkar FedML 16 7 0 30 May 2018
GossipGraD: Scalable Deep Learning using Gossip Communication based Asynchronous Gradient Descent J. Daily Abhinav Vishnu Charles Siegel T. Warfel Vinay C. Amatya 13 95 0 15 Mar 2018
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis Tal Ben-Nun Torsten Hoefler GNN 33 701 0 26 Feb 2018
Integrated Model, Batch and Domain Parallelism in Training Neural Networks A. Gholami A. Azad Peter H. Jin Kurt Keutzer A. Buluç 18 82 0 12 Dec 2017
ImageNet Training in Minutes Yang You Zhao-jie Zhang Cho-Jui Hsieh J. Demmel Kurt Keutzer VLM LRM 21 57 0 14 Sep 2017
Parle: parallelizing stochastic gradient descent Pratik Chaudhari Carlo Baldassi R. Zecchina Stefano Soatto Ameet Talwalkar Adam M. Oberman ODL FedML 29 21 0 03 Jul 2017
Collaborative Deep Learning in Fixed Topology Networks Zhanhong Jiang Aditya Balu C. Hegde S. Sarkar FedML 16 179 0 23 Jun 2017
Exploring the Design Space of Deep Convolutional Neural Networks at Large Scale F. Iandola 3DV 26 18 0 20 Dec 2016