Scalable Methods for 8-bit Training of Neural Networks

Scalable Methods for 8-bit Training of Neural Networks

25 May 2018

Papers citing "Scalable Methods for 8-bit Training of Neural Networks"

18 / 168 papers shown

Title
MLPerf Training Benchmark Arya D. McCarthy Christine Cheng Cody Coleman Greg Diamos Paulius Micikevicius ... Carole-Jean Wu Lingjie Xu Masafumi Yamazaki C. Young Matei A. Zaharia 38 305 0 02 Oct 2019
$λ$ -NIC: Interactive Serverless Compute on Programmable SmartNICs Sean Choi M. Shahbaz B. Prabhakar M. Rosenblum 28 47 0 26 Sep 2019
Training High-Performance and Large-Scale Deep Neural Networks with Full 8-bit Integers Yukuan Yang Shuang Wu Lei Deng Tianyi Yan Yuan Xie Guoqi Li MQ 99 111 0 05 Sep 2019
DeepCABAC: A Universal Compression Algorithm for Deep Neural Networks Simon Wiedemann H. Kirchhoffer Stefan Matlage Paul Haase Arturo Marbán ... Ahmed Osman D. Marpe H. Schwarz Thomas Wiegand Wojciech Samek 49 93 0 27 Jul 2019
Benchmarking TPU, GPU, and CPU Platforms for Deep Learning Y. Wang Gu-Yeon Wei David Brooks ELM VLM 28 274 0 24 Jul 2019
Terminal Brain Damage: Exposing the Graceless Degradation in Deep Neural Networks Under Hardware Fault Attacks Sanghyun Hong Pietro Frigo Yigitcan Kaya Cristiano Giuffrida Tudor Dumitras AAML 22 211 0 03 Jun 2019
A Mean Field Theory of Quantized Deep Networks: The Quantization-Depth Trade-Off Yaniv Blumenfeld D. Gilboa Daniel Soudry MQ 13 14 0 03 Jun 2019
HadaNets: Flexible Quantization Strategies for Neural Networks Yash Akhauri MQ 21 7 0 26 May 2019
SWALP : Stochastic Weight Averaging in Low-Precision Training Guandao Yang Tianyi Zhang Polina Kirichenko Junwen Bai A. Wilson Christopher De Sa 24 94 0 26 Apr 2019
Low-Memory Neural Network Training: A Technical Report N. Sohoni Christopher R. Aberger Megan Leszczynski Jian Zhang Christopher Ré 25 99 0 24 Apr 2019
Same, Same But Different - Recovering Neural Network Quantization Error Through Weight Factorization Eldad Meller Alexander Finkelstein Uri Almog Mark Grobman MQ 24 85 0 05 Feb 2019
QGAN: Quantized Generative Adversarial Networks Peiqi Wang Dongsheng Wang Yu Ji Xinfeng Xie Haoxuan Song XuXin Liu Yongqiang Lyu Yuan Xie GAN MQ 15 32 0 24 Jan 2019
Backprop with Approximate Activations for Memory-efficient Network Training Ayan Chakrabarti Benjamin Moseley 16 37 0 23 Jan 2019
Batch Normalization Sampling Zhaodong Chen Lei Deng Guoqi Li Jiawei Sun Xing Hu Xin Ma Yuan Xie 21 0 0 25 Oct 2018
Post-training 4-bit quantization of convolution networks for rapid-deployment Ron Banner Yury Nahshan Elad Hoffer Daniel Soudry MQ 19 93 0 02 Oct 2018
NICE: Noise Injection and Clamping Estimation for Neural Network Quantization Chaim Baskin Natan Liss Yoav Chai Evgenii Zheltonozhskii Eli Schwartz Raja Giryes A. Mendelson A. Bronstein MQ 14 60 0 29 Sep 2018
Compact and Computationally Efficient Representation of Deep Neural Networks Simon Wiedemann K. Müller Wojciech Samek MQ 34 66 0 27 May 2018
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 718 6,748 0 26 Sep 2016