Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations

22 September 2016

Papers citing "Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations"

50 / 301 papers shown

Title
Constructing Energy-efficient Mixed-precision Neural Networks through Principal Component Analysis for Edge Intelligence I. Chakraborty Deboleena Roy Isha Garg Aayush Ankit Kaushik Roy 24 37 0 04 Jun 2019
Mixed Precision Training With 8-bit Floating Point Naveen Mellempudi Sudarshan Srinivasan Dipankar Das Bharat Kaul MQ 18 69 0 29 May 2019
CGaP: Continuous Growth and Pruning for Efficient Deep Learning Xiaocong Du Zheng Li Yu Cao VLM 21 10 0 27 May 2019
Mixed Precision DNNs: All you need is a good parametrization Stefan Uhlich Lukas Mauch Fabien Cardinaux K. Yoshiyama Javier Alonso García Stephen Tiedemann Thomas Kemp Akira Nakamura MQ 27 38 0 27 May 2019
Natural Compression for Distributed Deep Learning Samuel Horváth Chen-Yu Ho L. Horvath Atal Narayan Sahu Marco Canini Peter Richtárik 21 151 0 27 May 2019
Feature Map Transform Coding for Energy-Efficient CNN Inference Brian Chmiel Chaim Baskin Ron Banner Evgenii Zheltonozhskii Yevgeny Yermolin Alex Karbachevsky A. Bronstein A. Mendelson 25 24 0 26 May 2019
Dichotomize and Generalize: PAC-Bayesian Binary Activated Deep Neural Networks Gaël Letarte Pascal Germain Benjamin Guedj Franccois Laviolette MQ AI4CE UQCV 28 54 0 24 May 2019
Zero-shot Knowledge Transfer via Adversarial Belief Matching P. Micaelli Amos Storkey 19 228 0 23 May 2019
Multi-layered Spiking Neural Network with Target Timestamp Threshold Adaptation and STDP Pierre Falez Pierre Tirilly Ioan Marius Bilasco P. Devienne Pierre Boulet 21 49 0 03 Apr 2019
Correlation Congruence for Knowledge Distillation Baoyun Peng Xiao Jin Jiaheng Liu Shunfeng Zhou Yichao Wu Yu Liu Dongsheng Li Zhaoning Zhang 63 507 0 03 Apr 2019
All You Need is a Few Shifts: Designing Efficient Convolutional Neural Networks for Image Classification Weijie Chen Di Xie Yuan Zhang Shiliang Pu 30 80 0 13 Mar 2019
Modulated binary cliquenet Jinpeng Xia Jiasong Wu Youyong Kong Pinzheng Zhang L. Senhadji H. Shu MQ 16 0 0 27 Feb 2019
Parameter Efficient Training of Deep Convolutional Neural Networks by Dynamic Sparse Reparameterization Hesham Mostafa Xin Wang 37 307 0 15 Feb 2019
An Optimized Recurrent Unit for Ultra-Low-Power Keyword Spotting Justice Amoh K. Odame 29 17 0 13 Feb 2019
Self-Binarizing Networks Fayez Lahoud R. Achanta Pablo Márquez-Neila Sabine Süsstrunk MQ 19 23 0 02 Feb 2019
Efficient Hybrid Network Architectures for Extremely Quantized Neural Networks Enabling Intelligence at the Edge I. Chakraborty Deboleena Roy Aayush Ankit Kaushik Roy GNN MQ 30 13 0 01 Feb 2019
Improving Neural Network Quantization without Retraining using Outlier Channel Splitting Ritchie Zhao Yuwei Hu Jordan Dotzel Christopher De Sa Zhiru Zhang OODD MQ 50 305 0 28 Jan 2019
QGAN: Quantized Generative Adversarial Networks Peiqi Wang Dongsheng Wang Yu Ji Xinfeng Xie Haoxuan Song XuXin Liu Yongqiang Lyu Yuan Xie GAN MQ 18 32 0 24 Jan 2019
Backprop with Approximate Activations for Memory-efficient Network Training Ayan Chakrabarti Benjamin Moseley 16 37 0 23 Jan 2019
CodeX: Bit-Flexible Encoding for Streaming-based FPGA Acceleration of DNNs Mohammad Samragh Mojan Javaheripi F. Koushanfar 32 11 0 17 Jan 2019
Unsupervised Visual Feature Learning with Spike-timing-dependent Plasticity: How Far are we from Traditional Feature Learning Approaches? Pierre Falez Pierre Tirilly Ioan Marius Bilasco P. Devienne Pierre Boulet SSL 26 32 0 14 Jan 2019
A Distributed Synchronous SGD Algorithm with Global Top- $k$ Sparsification for Low Bandwidth Networks S. Shi Qiang-qiang Wang Kaiyong Zhao Zhenheng Tang Yuxin Wang Xiang Huang Xiaowen Chu 40 135 0 14 Jan 2019
DSConv: Efficient Convolution Operator Marcelo Gennari Roger Fawcett V. Prisacariu MQ 32 62 0 07 Jan 2019
Precision Highway for Ultra Low-Precision Quantization Eunhyeok Park Dongyoung Kim S. Yoo Peter Vajda MQ AI4TS 21 12 0 24 Dec 2018
Proximal Mean-field for Neural Network Quantization Thalaiyasingam Ajanthan P. Dokania Richard I. Hartley Philip Torr MQ 38 20 0 11 Dec 2018
Knowledge Distillation with Feature Maps for Image Classification Wei-Chun Chen Chia-Che Chang Chien-Yu Lu Che-Rung Lee 29 35 0 03 Dec 2018
ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network Sachin Mehta Mohammad Rastegari Linda G. Shapiro Hannaneh Hajishirzi VLM 29 392 0 28 Nov 2018
Dense xUnit Networks I. Kligvasser T. Michaeli 21 3 0 27 Nov 2018
Efficient non-uniform quantizer for quantized neural network targeting reconfigurable hardware Natan Liss Chaim Baskin A. Mendelson A. Bronstein Raja Giryes MQ 24 5 0 27 Nov 2018
Structured Binary Neural Networks for Accurate Image Classification and Semantic Segmentation Bohan Zhuang Chunhua Shen Mingkui Tan Lingqiao Liu Ian Reid MQ 27 152 0 22 Nov 2018
QUENN: QUantization Engine for low-power Neural Networks Miguel de Prado Maurizio Denna Luca Benini Nuria Pazos MQ 35 14 0 14 Nov 2018
Online Embedding Compression for Text Classification using Low Rank Matrix Factorization Anish Acharya Rahul Goel A. Metallinou Inderjit Dhillon 25 58 0 01 Nov 2018
Convolutional Neural Network Quantization using Generalized Gamma Distribution Doyun Kim H. Yim Sanghyuck Ha Changgwun Lee Inyup Kang MQ 24 4 0 31 Oct 2018
Fault Tolerance in Iterative-Convergent Machine Learning Aurick Qiao Bryon Aragam Bingjing Zhang Eric Xing 26 41 0 17 Oct 2018
Quantization for Rapid Deployment of Deep Neural Networks J. Lee Sangwon Ha Saerom Choi Won-Jo Lee Seungwon Lee MQ 14 48 0 12 Oct 2018
Training Deep Neural Network in Limited Precision Hyunsun Park J. Lee Youngmin Oh Sangwon Ha Seungwon Lee 19 9 0 12 Oct 2018
Towards Fast and Energy-Efficient Binarized Neural Network Inference on FPGA Cheng Fu Shilin Zhu Hao Su Ching-En Lee Jishen Zhao MQ 25 31 0 04 Oct 2018
Relaxed Quantization for Discretized Neural Networks Christos Louizos M. Reisser Tijmen Blankevoort E. Gavves Max Welling MQ 36 131 0 03 Oct 2018
To compress or not to compress: Understanding the Interactions between Adversarial Attacks and Neural Network Compression Yiren Zhao Ilia Shumailov Robert D. Mullins Ross J. Anderson AAML 11 43 0 29 Sep 2018
Recent Advances in Object Detection in the Age of Deep Convolutional Neural Networks Shivang Agarwal Jean Ogier du Terrail F. Jurie ObjD 24 123 0 10 Sep 2018
DeepHunter: Hunting Deep Neural Network Defects via Coverage-Guided Fuzzing Xiaofei Xie Lei Ma Felix Juefei Xu Hongxu Chen Minhui Xue Bo-wen Li Yang Liu Jianjun Zhao Jianxiong Yin Simon See 43 40 0 04 Sep 2018
Learning to Quantize Deep Networks by Optimizing Quantization Intervals with Task Loss S. Jung Changyong Son Seohyung Lee JinWoo Son Youngjun Kwak Jae-Joon Han Sung Ju Hwang Changkyu Choi MQ 25 372 0 17 Aug 2018
Blended Coarse Gradient Descent for Full Quantization of Deep Neural Networks Penghang Yin Shuai Zhang J. Lyu Stanley Osher Y. Qi Jack Xin MQ 44 61 0 15 Aug 2018
Training Compact Neural Networks with Binary Weights and Low Precision Activations Bohan Zhuang Chunhua Shen Ian Reid MQ 13 14 0 08 Aug 2018
Bi-Real Net: Enhancing the Performance of 1-bit CNNs With Improved Representational Capability and Advanced Training Algorithm Zechun Liu Baoyuan Wu Wenhan Luo Xin Yang Wei Liu K. Cheng MQ 46 550 0 01 Aug 2018
DFTerNet: Towards 2-bit Dynamic Fusion Networks for Accurate Human Activity Recognition Zhan Yang Osolo Ian Raymond Chengyuan Zhang Ying Wan J. Long CVBM 42 36 0 31 Jul 2018
Bridging the Accuracy Gap for 2-bit Quantized Neural Networks (QNN) Jungwook Choi P. Chuang Zhuo Wang Swagath Venkataramani Vijayalakshmi Srinivasan K. Gopalakrishnan MQ 16 75 0 17 Jul 2018
FINN-L: Library Extensions and Design Trade-off Analysis for Variable Precision LSTM Networks on FPGAs Vladimir Rybalkin Alessandro Pappalardo M. M. Ghaffar Giulio Gambardella Norbert Wehn Michaela Blott 19 72 0 11 Jul 2018
SYQ: Learning Symmetric Quantization For Efficient Deep Neural Networks Julian Faraone Nicholas J. Fraser Michaela Blott Philip H. W. Leong MQ 33 133 0 01 Jul 2018
Binary Ensemble Neural Network: More Bits per Network or More Networks per Bit? Shilin Zhu Xin Dong Hao Su MQ 30 135 0 20 Jun 2018