Benchmarking Resource Usage for Efficient Distributed Deep Learning

Benchmarking Resource Usage for Efficient Distributed Deep Learning

28 January 2022

Baolin Li

Joseph McDonald

Michael Jones

Devesh Tiwari

ArXiv (abs)PDF HTML

Papers citing "Benchmarking Resource Usage for Efficient Distributed Deep Learning"

18 / 18 papers shown

Title
Scalable Geometric Deep Learning on Molecular Graphs Nathan C. Frey S. Samsi Joseph McDonald Lin Li Connor W. Coley V. Gadepally GNN AI4CE 60 4 0 06 Dec 2021
Characterization and Prediction of Deep Learning Workloads in Large-Scale GPU Datacenters Qi Hu Peng Sun Shengen Yan Yonggang Wen Tianwei Zhang 3DH GNN 59 131 0 03 Sep 2021
Revisiting ResNets: Improved Training and Scaling Strategies Irwan Bello W. Fedus Xianzhi Du E. D. Cubuk A. Srinivas Nayeon Lee Jonathon Shlens Barret Zoph 84 300 0 13 Mar 2021
Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Molecules Johannes Klicpera Shankari Giri Johannes T. Margraf Stephan Günnemann 79 323 0 28 Nov 2020
Survey of Machine Learning Accelerators Albert Reuther Peter Michaleas Michael Jones V. Gadepally S. Samsi J. Kepner 45 136 0 01 Sep 2020
Predicting Training Time Without Training Luca Zancato Alessandro Achille Avinash Ravichandran Rahul Bhotika Stefano Soatto 122 24 0 28 Aug 2020
The Computational Limits of Deep Learning Neil C. Thompson Kristjan Greenewald Keeheon Lee Gabriel F. Manso VLM 53 528 0 10 Jul 2020
The Cost of Training NLP Models: A Concise Overview Or Sharir Barak Peleg Y. Shoham 96 214 0 19 Apr 2020
Designing Network Design Spaces Ilija Radosavovic Raj Prateek Kosaraju Ross B. Girshick Kaiming He Piotr Dollár GNN 102 1,682 0 30 Mar 2020
Directional Message Passing for Molecular Graphs Johannes Klicpera Janek Groß Stephan Günnemann 124 875 0 06 Mar 2020
Quantifying the Carbon Emissions of Machine Learning Alexandre Lacoste A. Luccioni Victor Schmidt Thomas Dandres 94 707 0 21 Oct 2019
Fast Graph Representation Learning with PyTorch Geometric Matthias Fey J. E. Lenssen 3DH GNN 3DPC 226 4,341 0 06 Mar 2019
Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloads Myeongjae Jeon Shivaram Venkataraman Amar Phanishayee Junjie Qian Wencong Xiao Fan Yang GNN 65 352 0 17 Jan 2019
Deep Learning Inference in Facebook Data Centers: Characterization, Performance Optimizations and Hardware Implications Jongsoo Park Maxim Naumov Protonu Basu Summer Deng Aravind Kalaiah ... Lin Qiao Vijay Rao Nadav Rotem S. Yoo M. Smelyanskiy FedML GNN BDL 72 187 0 24 Nov 2018
SchNet: A continuous-filter convolutional neural network for modeling quantum interactions Kristof T. Schütt Pieter-Jan Kindermans Huziel Enoc Sauceda Felix Stefan Chmiela A. Tkatchenko K. Müller 155 1,076 0 26 Jun 2017
Geometric deep learning: going beyond Euclidean data M. Bronstein Joan Bruna Yann LeCun Arthur Szlam P. Vandergheynst GNN 808 3,287 0 24 Nov 2016
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 465 5,373 0 05 Nov 2016
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 328 2,876 0 26 Sep 2016

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.