Automatic Configuration for Optimal Communication Scheduling in DNN Training

27 December 2021

Papers citing "Automatic Configuration for Optimal Communication Scheduling in DNN Training"

9 / 9 papers shown

Title
AutoML: A Survey of the State-of-the-Art Xin He Kaiyong Zhao Xiaowen Chu 79 1,440 0 02 Aug 2019
Priority-based Parameter Propagation for Distributed DNN Training Anand Jayarajan Jinliang Wei Garth A. Gibson Alexandra Fedorova Gennady Pekhimenko AI4CE 38 178 0 10 May 2019
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 154 1,056 0 24 May 2018
TicTac: Accelerating Distributed Deep Learning with Communication Scheduling Sayed Hadi Hashemi Sangeetha Abdu Jyothi R. Campbell 35 196 0 08 Mar 2018
Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training Chengyue Wu Song Han Huizi Mao Yu Wang W. Dally 107 1,399 0 05 Dec 2017
Poseidon: An Efficient Communication Architecture for Distributed Deep Learning on GPU Clusters Huatian Zhang Zeyu Zheng Shizhen Xu Wei-Ming Dai Qirong Ho Xiaodan Liang Zhiting Hu Jinliang Wei P. Xie Eric Xing GNN 54 343 0 11 Jun 2017
TensorFlow: A system for large-scale machine learning Martín Abadi P. Barham Jianmin Chen Zhiwen Chen Andy Davis ... Vijay Vasudevan Pete Warden Martin Wicke Yuan Yu Xiaoqiang Zhang GNN AI4CE 349 18,300 0 27 May 2016
Practical Bayesian Optimization of Machine Learning Algorithms Jasper Snoek Hugo Larochelle Ryan P. Adams 298 7,883 0 13 Jun 2012
A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning E. Brochu Vlad M. Cora Nando de Freitas GP 116 2,437 0 12 Dec 2010