Towards Fully 8-bit Integer Inference for the Transformer Model

v1v2 (latest)

Towards Fully 8-bit Integer Inference for the Transformer Model

17 September 2020

Jingbo Zhu

ArXiv (abs)PDF HTML

Papers citing "Towards Fully 8-bit Integer Inference for the Transformer Model"

17 / 17 papers shown

Title
Neural Machine Translation with Joint Representation Yanyang Li Qiang Wang Tong Xiao Tongran Liu Jingbo Zhu 28 9 0 16 Feb 2020
Learning Accurate Integer Transformer Machine-Translation Models Ephrem Wu 36 4 0 03 Jan 2020
Sharing Attention Weights for Fast Transformer Tong Xiao Yinqiao Li Jingbo Zhu Zhengtao Yu Tongran Liu 60 52 0 26 Jun 2019
Energy and Policy Considerations for Deep Learning in NLP Emma Strubell Ananya Ganesh Andrew McCallum 73 2,660 0 05 Jun 2019
Learning Deep Transformer Models for Machine Translation Qiang Wang Bei Li Tong Xiao Jingbo Zhu Changliang Li Derek F. Wong Lidia S. Chao 80 672 0 05 Jun 2019
Efficient 8-Bit Quantization of Transformer Neural Machine Language Translation Model Aishwarya Bhandare Vamsi Sripathi Deepthi Karkada Vivek V. Menon Sun Choi Kushal Datta V. Saletore MQ 74 132 0 03 Jun 2019
Rethinking floating point for deep learning Jeff Johnson MQ 109 139 0 01 Nov 2018
Adaptive Input Representations for Neural Language Modeling Alexei Baevski Michael Auli 106 390 0 28 Sep 2018
Highly Efficient 8-bit Low Precision Inference of Convolutional Neural Networks with IntelCaffe Jiong Gong Haihao Shen Guoming Zhang Xiaoli Liu Shane Li Ge Jin Niharika Maheshwari Evarist Fomenko Eden Segal BDL MQ 44 33 0 04 May 2018
Pieces of Eight: 8-bit Neural Machine Translation Jerry Quinn Miguel Ballesteros MQ 56 25 0 13 Apr 2018
Norm matters: efficient and accurate normalization schemes in deep networks Elad Hoffer Ron Banner Itay Golan Daniel Soudry OffRL 70 179 0 05 Mar 2018
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference Benoit Jacob S. Kligys Bo Chen Menglong Zhu Matthew Tang Andrew G. Howard Hartwig Adam Dmitry Kalenichenko MQ 164 3,141 0 15 Dec 2017
Mixed Precision Training Paulius Micikevicius Sharan Narang Jonah Alben G. Diamos Erich Elsen ... Boris Ginsburg Michael Houston Oleksii Kuchaiev Ganesh Venkatesh Hao Wu 174 1,805 0 10 Oct 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 781 132,363 0 12 Jun 2017
Efficient Processing of Deep Neural Networks: A Tutorial and Survey Vivienne Sze Yu-hsin Chen Tien-Ju Yang J. Emer AAML 3DV 120 3,026 0 27 Mar 2017
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,426 0 10 Dec 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 338 18,651 0 06 Feb 2015

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.