Deep Learning Scaling is Predictable, Empirically

1 December 2017

Sharan Narang

Md. Mostofa Ali Patwary

Yang Yang

Yanqi Zhou

ArXiv (abs)PDF HTML

Papers citing "Deep Learning Scaling is Predictable, Empirically"

22 / 372 papers shown

Title
Human uncertainty makes classification more robust Joshua C. Peterson Ruairidh M. Battleday Thomas Griffiths Olga Russakovsky OOD 74 306 0 19 Aug 2019
Less (Data) Is More: Why Small Data Holds the Key to the Future of Artificial Intelligence C. Greco A. Polonioli Jacopo Tagliabue 48 4 0 22 Jul 2019
Minimizers of the Empirical Risk and Risk Monotonicity Marco Loog T. Viering A. Mey 66 29 0 11 Jul 2019
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges N. Arivazhagan Ankur Bapna Orhan Firat Dmitry Lepikhin Melvin Johnson ... George F. Foster Colin Cherry Wolfgang Macherey Zhiwen Chen Yonghui Wu 109 429 0 11 Jul 2019
Selection via Proxy: Efficient Data Selection for Deep Learning Cody Coleman Christopher Yeh Stephen Mussmann Baharan Mirzasoleiman Peter Bailis Percy Liang J. Leskovec Matei A. Zaharia 134 351 0 26 Jun 2019
One Epoch Is All You Need Aran Komatsuzaki 78 51 0 16 Jun 2019
Landslide Geohazard Assessment With Convolutional Neural Networks Using Sentinel-2 Imagery Data Silvia L. Ullo Maximillian S. Langenkamp Tuomas P. Oikarinen M. P. D. Rosso A. Sebastianelli Federica Piccirillo S. Sica 28 25 0 10 Jun 2019
Multimodal End-to-End Autonomous Driving Yi Xiao Felipe Codevilla A. Gurram O. Urfalioglu Antonio M. López 96 246 0 07 Jun 2019
Asymptotic learning curves of kernel methods: empirical data v.s. Teacher-Student paradigm S. Spigler Mario Geiger Matthieu Wyart 121 38 0 26 May 2019
A Survey on Face Data Augmentation Xiang Wang Kai Wang Kai Wang CVBM 116 134 0 26 Apr 2019
Deep Learning in steganography and steganalysis from 2015 to 2018 Marc Chaumont 56 48 0 31 Mar 2019
Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques and Tools R. Mayer Hans-Arno Jacobsen GNN 83 193 0 27 Mar 2019
A Brain-inspired Algorithm for Training Highly Sparse Neural Networks Zahra Atashgahi Joost Pieterse Shiwei Liu Decebal Constantin Mocanu Raymond N. J. Veldhuis Mykola Pechenizkiy 83 15 0 17 Mar 2019
The State of Sparsity in Deep Neural Networks Trevor Gale Erich Elsen Sara Hooker 193 765 0 25 Feb 2019
Technical Considerations for Semantic Segmentation in MRI using Convolutional Neural Networks Arjun D Desai G. Gold B. Hargreaves Akshay S. Chaudhari 72 30 0 05 Feb 2019
Impact of Training Dataset Size on Neural Answer Selection Models Trond Linjordet K. Balog 61 38 0 29 Jan 2019
Machine learning in resting-state fMRI analysis Meenakshi Khosla K. Jamison G. Ngo Amy Kuceyeski M. Sabuncu 53 175 0 30 Dec 2018
An Empirical Model of Large-Batch Training Sam McCandlish Jared Kaplan Dario Amodei OpenAI Dota Team 76 280 0 14 Dec 2018
Measuring the Effects of Data Parallelism on Neural Network Training Christopher J. Shallue Jaehoon Lee J. Antognini J. Mamou J. Ketterling Yao Wang 129 409 0 08 Nov 2018
Large Scale Language Modeling: Converging on 40GB of Text in Four Hours Raul Puri Robert M. Kirby Nikolai Yakovenko Bryan Catanzaro 79 29 0 03 Aug 2018
Why Is My Classifier Discriminatory? Irene Y. Chen Fredrik D. Johansson David Sontag FaML 99 399 0 30 May 2018
Massively Parallel Cross-Lingual Learning in Low-Resource Target Language Translation Zhong Zhou Matthias Sperber A. Waibel 47 13 0 21 Apr 2018