Training and Inference with Integers in Deep Neural Networks

13 February 2018

Papers citing "Training and Inference with Integers in Deep Neural Networks"

50 / 153 papers shown

Title
Quantization Networks Jiwei Yang Xu Shen Jun Xing Xinmei Tian Houqiang Li Bing Deng Jianqiang Huang Xiansheng Hua MQ 30 339 0 21 Nov 2019
Distributed Low Precision Training Without Mixed Precision Zehua Cheng Weiyan Wang Yan Pan Thomas Lukasiewicz MQ 18 5 0 18 Nov 2019
Comprehensive SNN Compression Using ADMM Optimization and Activity Regularization Lei Deng Yujie Wu Yifan Hu Ling Liang Guoqi Li Xing Hu Yufei Ding Peng Li Yuan Xie 30 80 0 03 Nov 2019
Adaptive Precision Training: Quantify Back Propagation in Neural Networks with Fixed-point Numbers Xishan Zhang Shaoli Liu Rui Zhang Chang-Shu Liu Di Huang ... Jiaming Guo Yu Kang Qi Guo Zidong Du Yunji Chen MQ 21 6 0 01 Nov 2019
On Distributed Quantization for Classification Osama A. Hanna Yahya H. Ezzeldin Tara Sadjadpour Christina Fragouli Suhas Diggavi MQ 14 14 0 01 Nov 2019
Secure Evaluation of Quantized Neural Networks Anders Dalskov Daniel E. Escudero Marcel Keller 17 137 0 28 Oct 2019
Reversible designs for extreme memory cost reduction of CNN training T. Hascoet Q. Febvre Y. Ariki T. Takiguchi 3DV 6 2 0 24 Oct 2019
Circulant Binary Convolutional Networks: Enhancing the Performance of 1-bit DCNNs with Circulant Back Propagation Chunlei Liu Wenrui Ding Xin Xia Baochang Zhang Jiaxin Gu Jianzhuang Liu Rongrong Ji David Doermann MQ 10 73 0 24 Oct 2019
Neural Network Design for Energy-Autonomous AI Applications using Temporal Encoding S. Mileiko Thanasin Bunnam F. Xia R. Shafik Alex Yakovlev Shidhartha Das 14 0 0 15 Oct 2019
QPyTorch: A Low-Precision Arithmetic Simulation Framework Tianyi Zhang Zhiqiu Lin Guandao Yang Christopher De Sa MQ 26 64 0 09 Oct 2019
Training Deep Neural Networks Using Posit Number System Jinming Lu Siyuan Lu Zhisheng Wang Chao Fang Jun Lin Zhongfeng Wang Li Du MQ 19 13 0 06 Sep 2019
Training High-Performance and Large-Scale Deep Neural Networks with Full 8-bit Integers Yukuan Yang Shuang Wu Lei Deng Tianyi Yan Yuan Xie Guoqi Li MQ 99 110 0 05 Sep 2019
Bayesian Optimized 1-Bit CNNs Jiaxin Gu Junhe Zhao Xiaolong Jiang Baochang Zhang Jianzhuang Liu G. Guo Rongrong Ji BDL MQ 17 56 0 17 Aug 2019
Group Pruning using a Bounded-Lp norm for Group Gating and Regularization Chaithanya Kumar Mummadi Tim Genewein Dan Zhang Thomas Brox Volker Fischer 32 3 0 09 Aug 2019
QUOTIENT: Two-Party Secure Neural Network Training and Prediction Nitin Agrawal Ali Shahin Shamsabadi Matt J. Kusner Adria Gascon 30 212 0 08 Jul 2019
Table-Based Neural Units: Fully Quantizing Networks for Multiply-Free Inference Michele Covell David Marwood S. Baluja Nick Johnston MQ 19 7 0 11 Jun 2019
SpikeGrad: An ANN-equivalent Computation Model for Implementing Backpropagation with Spikes Johannes C. Thiele O. Bichler A. Dupret 15 32 0 03 Jun 2019
Efficient 8-Bit Quantization of Transformer Neural Machine Language Translation Model Aishwarya Bhandare Vamsi Sripathi Deepthi Karkada Vivek V. Menon Sun Choi Kushal Datta V. Saletore MQ 27 130 0 03 Jun 2019
Mixed Precision Training With 8-bit Floating Point Naveen Mellempudi Sudarshan Srinivasan Dipankar Das Bharat Kaul MQ 18 68 0 29 May 2019
Instant Quantization of Neural Networks using Monte Carlo Methods Gonçalo Mordido Matthijs Van Keirsbilck A. Keller MQ 27 9 0 29 May 2019
SWALP : Stochastic Weight Averaging in Low-Precision Training Guandao Yang Tianyi Zhang Polina Kirichenko Junwen Bai A. Wilson Christopher De Sa 24 94 0 26 Apr 2019
Distilling Task-Specific Knowledge from BERT into Simple Neural Networks Raphael Tang Yao Lu Linqing Liu Lili Mou Olga Vechtomova Jimmy J. Lin 21 153 0 28 Mar 2019
Performance-Efficiency Trade-off of Low-Precision Numerical Formats in Deep Neural Networks Zachariah Carmichael H. F. Langroudi Char Khazanov Jeffrey Lillie J. Gustafson Dhireesha Kudithipudi 18 55 0 25 Mar 2019
Convolution with even-sized kernels and symmetric padding Shuang Wu Guanrui Wang Pei Tang F. Chen Luping Shi 19 67 0 20 Mar 2019
Fast-SCNN: Fast Semantic Segmentation Network Rudra P. K. Poudel Stephan Liwicki R. Cipolla SSeg 18 503 0 12 Feb 2019
Improving Neural Network Quantization without Retraining using Outlier Channel Splitting Ritchie Zhao Yuwei Hu Jordan Dotzel Christopher De Sa Zhiru Zhang OODD MQ 50 305 0 28 Jan 2019
Deep Neural Network Approximation for Custom Hardware: Where We've Been, Where We're Going Erwei Wang James J. Davis Ruizhe Zhao Ho-Cheung Ng Xinyu Niu Wayne Luk P. Cheung George A. Constantinides 24 59 0 21 Jan 2019
Accumulation Bit-Width Scaling For Ultra-Low Precision Training Of Deep Networks Charbel Sakr Naigang Wang Chia-Yu Chen Jungwook Choi A. Agrawal Naresh R Shanbhag K. Gopalakrishnan MQ 22 34 0 19 Jan 2019
DSConv: Efficient Convolution Operator Marcelo Gennari Roger Fawcett V. Prisacariu MQ 32 62 0 07 Jan 2019
Per-Tensor Fixed-Point Quantization of the Back-Propagation Algorithm Charbel Sakr Naresh R Shanbhag MQ 9 43 0 31 Dec 2018
Training Deep Neural Networks with 8-bit Floating Point Numbers Naigang Wang Jungwook Choi D. Brand Chia-Yu Chen K. Gopalakrishnan MQ 17 496 0 19 Dec 2018
Efficient and Robust Machine Learning for Real-World Systems Franz Pernkopf Wolfgang Roth Matthias Zöhrer Lukas Pfeifenberger Günther Schindler Holger Froening Sebastian Tschiatschek Robert Peharz Matthew Mattina Zoubin Ghahramani OOD 27 1 0 05 Dec 2018
Deep Positron: A Deep Neural Network Using the Posit Number System Zachariah Carmichael Seyed Hamed Fatemi Langroudi Char Khazanov Jeffrey Lillie J. Gustafson Dhireesha Kudithipudi MQ 9 96 0 05 Dec 2018
Projection Convolutional Neural Networks for 1-bit CNNs via Discrete Back Propagation Jiaxin Gu Ce Li Baochang Zhang J. Han Xianbin Cao Jianzhuang Liu David Doermann 3DV 176 86 0 30 Nov 2018
Generalized Ternary Connect: End-to-End Learning and Compression of Multiplication-Free Deep Neural Networks Samyak Parajuli Aswin Raghavan S. Chai 16 7 0 12 Nov 2018
DeepTwist: Learning Model Compression via Occasional Weight Distortion Dongsoo Lee Parichay Kapoor Byeongwook Kim 30 19 0 30 Oct 2018
Relaxed Quantization for Discretized Neural Networks Christos Louizos M. Reisser Tijmen Blankevoort E. Gavves Max Welling MQ 33 131 0 03 Oct 2018
Post-training 4-bit quantization of convolution networks for rapid-deployment Ron Banner Yury Nahshan Elad Hoffer Daniel Soudry MQ 19 93 0 02 Oct 2018
Dynamic Sparse Graph for Efficient Deep Learning L. Liu Lei Deng Xing Hu Maohua Zhu Guoqi Li Yufei Ding Yuan Xie GNN 32 42 0 01 Oct 2018
No Multiplication? No Floating Point? No Problem! Training Networks for Efficient Inference S. Baluja David Marwood Michele Covell Nick Johnston MQ 16 8 0 24 Sep 2018
Discovering Low-Precision Networks Close to Full-Precision Networks for Efficient Embedded Inference J. McKinstry S. K. Esser R. Appuswamy Deepika Bablani John V. Arthur Izzet B. Yildiz D. Modha MQ 18 94 0 11 Sep 2018
DeepHunter: Hunting Deep Neural Network Defects via Coverage-Guided Fuzzing Xiaofei Xie L. Ma Felix Juefei Xu Hongxu Chen Minhui Xue Bo-wen Li Yang Liu Jianjun Zhao Jianxiong Yin Simon See 40 40 0 04 Sep 2018
Learning to Quantize Deep Networks by Optimizing Quantization Intervals with Task Loss S. Jung Changyong Son Seohyung Lee JinWoo Son Youngjun Kwak Jae-Joon Han Sung Ju Hwang Changkyu Choi MQ 25 372 0 17 Aug 2018
A Survey on Methods and Theories of Quantized Neural Networks Yunhui Guo MQ 29 231 0 13 Aug 2018
Quantized Densely Connected U-Nets for Efficient Landmark Localization Zhiqiang Tang Xi Peng Shijie Geng Lingfei Wu Shaoting Zhang Dimitris N. Metaxas 3DV 19 143 0 07 Aug 2018
Slalom: Fast, Verifiable and Private Execution of Neural Networks in Trusted Hardware Florian Tramèr Dan Boneh FedML 114 395 0 08 Jun 2018
Retraining-Based Iterative Weight Quantization for Deep Neural Networks Dongsoo Lee Byeongwook Kim MQ 36 16 0 29 May 2018
Scalable Methods for 8-bit Training of Neural Networks Ron Banner Itay Hubara Elad Hoffer Daniel Soudry MQ 39 331 0 25 May 2018
ContextNet: Exploring Context and Detail for Semantic Segmentation in Real-time Rudra P. K. Poudel Ujwal D. Bonde Stephan Liwicki Christopher Zach SSeg 38 227 0 11 May 2018
Low-Precision Floating-Point Schemes for Neural Network Training Marc Ortiz A. Cristal Eduard Ayguadé Marc Casas MQ 30 22 0 14 Apr 2018