Efficient 8-Bit Quantization of Transformer Neural Machine Language
Translation Model

v1v2 (latest)

Efficient 8-Bit Quantization of Transformer Neural Machine Language Translation Model

3 June 2019

Aishwarya Bhandare

Deepthi Karkada

ArXiv (abs)PDF HTML

Papers citing "Efficient 8-Bit Quantization of Transformer Neural Machine Language Translation Model"

12 / 12 papers shown

Title
AnchorFormer: Differentiable Anchor Attention for Efficient Vision Transformer Jiquan Shan Junxiao Wang Lifeng Zhao Liang Cai Hongyuan Zhang Ioannis Liritzis ViT 228 0 0 22 May 2025
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Value-aware Quantization for Training and Inference of Neural Networks Eunhyeok Park S. Yoo Peter Vajda MQ 50 163 0 20 Apr 2018
Loss-aware Weight Quantization of Deep Networks Lu Hou James T. Kwok MQ 82 127 0 23 Feb 2018
Training and Inference with Integers in Deep Neural Networks Shuang Wu Guoqi Li F. Chen Luping Shi MQ 65 391 0 13 Feb 2018
Effective Quantization Approaches for Recurrent Neural Networks Md. Zahangir Alom A. Moody N. Maruyama B. Van Essen T. Taha MQ 45 35 0 07 Feb 2018
State-of-the-art Speech Recognition With Sequence-to-Sequence Models Chung-Cheng Chiu Tara N. Sainath Yonghui Wu Rohit Prabhavalkar Patrick Nguyen ... Katya Gonina Navdeep Jaitly Yue Liu J. Chorowski M. Bacchiani AI4TS 93 1,154 0 05 Dec 2017
Generating Sentences by Editing Prototypes Kelvin Guu Tatsunori B. Hashimoto Yonatan Oren Percy Liang 154 316 0 26 Sep 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 730 132,363 0 12 Jun 2017
Ternary Neural Networks with Fine-Grained Quantization Naveen Mellempudi Abhisek Kundu Dheevatsa Mudigere Dipankar Das Bharat Kaul Pradeep Dubey MQ 97 111 0 02 May 2017
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 422 10,526 0 21 Jul 2016
Quantized Convolutional Neural Networks for Mobile Devices Jiaxiang Wu Cong Leng Yuhang Wang Qinghao Hu Jian Cheng MQ 99 1,166 0 21 Dec 2015

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.