DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients

20 June 2016

Shuchang Zhou

Papers citing "DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients"

50 / 444 papers shown

Title
DAQ: Channel-Wise Distribution-Aware Quantization for Deep Image Super-Resolution Networks Chee Hong Heewon Kim Sungyong Baik Junghun Oh Kyoung Mu Lee OOD SupR MQ 24 41 0 21 Dec 2020
Robustness and Transferability of Universal Attacks on Compressed Models Alberto G. Matachana Kenneth T. Co Luis Muñoz-González David Martínez Emil C. Lupu AAML 29 10 0 10 Dec 2020
Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework Sung-En Chang Yanyu Li Mengshu Sun Runbin Shi Hayden Kwok-Hay So Xuehai Qian Yanzhi Wang Xue Lin MQ 26 83 0 08 Dec 2020
Improving Accuracy of Binary Neural Networks using Unbalanced Activation Distribution Hyungjun Kim Jihoon Park Chang-Ho Lee Jae-Joon Kim MQ 20 30 0 02 Dec 2020
Bringing AI To Edge: From Deep Learning's Perspective Di Liu Hao Kong Xiangzhong Luo Weichen Liu Ravi Subramaniam 57 117 0 25 Nov 2020
Larq Compute Engine: Design, Benchmark, and Deploy State-of-the-Art Binarized Neural Networks T. Bannink Arash Bakhtiari Adam Hillier Lukas Geiger T. D. Bruin Leon Overweel J. Neeven K. Helwegen 3DV MQ 13 36 0 18 Nov 2020
Neural Network Compression Via Sparse Optimization Tianyi Chen Bo Ji Yixin Shi Tianyu Ding Biyi Fang Sheng Yi Xiao Tu 36 15 0 10 Nov 2020
Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNets Kai Han Yunhe Wang Qiulin Zhang Wei Zhang Chunjing Xu Tong Zhang 24 87 0 28 Oct 2020
A Statistical Framework for Low-bitwidth Training of Deep Neural Networks Jianfei Chen Yujie Gai Z. Yao Michael W. Mahoney Joseph E. Gonzalez MQ 20 58 0 27 Oct 2020
Training Binary Neural Networks through Learning with Noisy Supervision Kai Han Yunhe Wang Yixing Xu Chunjing Xu Enhua Wu Chang Xu MQ 15 55 0 10 Oct 2020
Once Quantization-Aware Training: High Performance Extremely Low-bit Architecture Search Mingzhu Shen Feng Liang Ruihao Gong Yuhang Li Chuming Li Chen Lin F. Yu Junjie Yan Wanli Ouyang MQ 36 36 0 09 Oct 2020
High-Capacity Expert Binary Networks Adrian Bulat Brais Martínez Georgios Tzimiropoulos MQ 27 57 0 07 Oct 2020
Binary Neural Networks for Memory-Efficient and Effective Visual Place Recognition in Changing Environments Bruno Ferrarini Michael Milford Klaus D. McDonald-Maier Shoaib Ehsan MQ 25 23 0 01 Oct 2020
Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks Yoonho Boo Sungho Shin Jungwook Choi Wonyong Sung MQ 30 29 0 30 Sep 2020
Rotated Binary Neural Network Mingbao Lin Rongrong Ji Zi-Han Xu Baochang Zhang Yan Wang Yongjian Wu Feiyue Huang Chia-Wen Lin MQ 24 129 0 28 Sep 2020
Kernel Based Progressive Distillation for Adder Neural Networks Yixing Xu Chang Xu Xinghao Chen Wei Zhang Chunjing Xu Yunhe Wang 46 47 0 28 Sep 2020
Sparse Communication for Training Deep Networks Negar Foroutan Martin Jaggi FedML 30 16 0 19 Sep 2020
MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework Sung-En Chang Yanyu Li Mengshu Sun Weiwen Jiang Runbin Shi Xue Lin Yanzhi Wang MQ 27 7 0 16 Sep 2020
Fast Implementation of 4-bit Convolutional Neural Networks for Mobile Devices A. Trusov E. Limonova Dmitry Slugin D. Nikolaev V. Arlazarov MQ 30 17 0 14 Sep 2020
Alternating Direction Method of Multipliers for Quantization Tianjian Huang Prajwal Singhania Maziar Sanjabi Pabitra Mitra Meisam Razaviyayn MQ 30 10 0 08 Sep 2020
Layer-specific Optimization for Mixed Data Flow with Mixed Precision in FPGA Design for CNN-based Object Detectors Duy-Thanh Nguyen Hyun Kim Hyuk-Jae Lee MQ 25 60 0 03 Sep 2020
Transform Quantization for CNN (Convolutional Neural Network) Compression Sean I. Young Wang Zhe David S. Taubman B. Girod MQ 36 69 0 02 Sep 2020
Stochastic Markov Gradient Descent and Training Low-Bit Neural Networks Jonathan Ashbrock A. Powell MQ 32 5 0 25 Aug 2020
Leveraging Automated Mixed-Low-Precision Quantization for tiny edge microcontrollers Manuele Rusci Marco Fariselli Alessandro Capotondi Luca Benini MQ 24 17 0 12 Aug 2020
Distance-Weighted Graph Neural Networks on FPGAs for Real-Time Particle Reconstruction in High Energy Physics Y. Iiyama G. Cerminara Abhijay Gupta J. Kieseler Vladimir Loncar ... Miaoyuan Liu K. Pedro N. Tran E. Kreinar Zhenbin Wu 21 66 0 08 Aug 2020
NASB: Neural Architecture Search for Binary Convolutional Neural Networks Baozhou Zhu Zaid Al-Ars P. Hofstee MQ 24 23 0 08 Aug 2020
Controlling Information Capacity of Binary Neural Network D. Ignatov Andrey D. Ignatov MQ 42 21 0 04 Aug 2020
MCUNet: Tiny Deep Learning on IoT Devices Ji Lin Wei-Ming Chen Chengyue Wu J. Cohn Chuang Gan Song Han 93 482 0 20 Jul 2020
Search What You Want: Barrier Panelty NAS for Mixed Precision Quantization Haibao Yu Qi Han Jianbo Li Jianping Shi Guangliang Cheng Bin Fan MQ 21 61 0 20 Jul 2020
AQD: Towards Accurate Fully-Quantized Object Detection Peng Chen Jing Liu Bohan Zhuang Mingkui Tan Chunhua Shen MQ 34 10 0 14 Jul 2020
T-Basis: a Compact Representation for Neural Networks Anton Obukhov M. Rakhuba Stamatios Georgoulis Menelaos Kanakis Dengxin Dai Luc Van Gool 41 27 0 13 Jul 2020
Distillation Guided Residual Learning for Binary Convolutional Neural Networks Jianming Ye Shiliang Zhang Jingdong Wang MQ 33 19 0 10 Jul 2020
Optical Flow Distillation: Towards Efficient and Stable Video Style Transfer Xinghao Chen Yiman Zhang Yunhe Wang Han Shu Chunjing Xu Chang Xu VGen 26 54 0 10 Jul 2020
Hardware Acceleration of Sparse and Irregular Tensor Computations of ML Models: A Survey and Insights Shail Dave Riyadh Baghdadi Tony Nowatzki Sasikanth Avancha Aviral Shrivastava Baoxin Li 64 82 0 02 Jul 2020
Scheduling Policy and Power Allocation for Federated Learning in NOMA Based MEC Xiang Ma Haijian Sun R. Hu 19 39 0 21 Jun 2020
Multi-Precision Policy Enforced Training (MuPPET): A precision-switching strategy for quantised fixed-point training of CNNs A. Rajagopal D. A. Vink Stylianos I. Venieris C. Bouganis MQ 21 14 0 16 Jun 2020
APQ: Joint Search for Network Architecture, Pruning and Quantization Policy Tianzhe Wang Kuan-Chieh Wang Han Cai Ji Lin Zhijian Liu Song Han MQ 39 174 0 15 Jun 2020
Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors C. Coelho Aki Kuusela Shane Li Zhuang Hao T. Aarrestad Vladimir Loncar J. Ngadiuba M. Pierini Adrian Alan Pol S. Summers MQ 48 178 0 15 Jun 2020
Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming Itay Hubara Yury Nahshan Y. Hanani Ron Banner Daniel Soudry MQ 35 123 0 14 Jun 2020
Defensive Approximation: Securing CNNs using Approximate Computing Amira Guesmi Ihsen Alouani Khaled N. Khasawneh M. Baklouti T. Frikha Mohamed Abid Nael B. Abu-Ghazaleh AAML 19 37 0 13 Jun 2020
An Overview of Neural Network Compression James OÑeill AI4CE 52 98 0 05 Jun 2020
Path Sample-Analytic Gradient Estimators for Stochastic Binary Networks Alexander Shekhovtsov V. Yanush B. Flach MQ 39 11 0 04 Jun 2020
Quantized Neural Networks: Characterization and Holistic Optimization Yoonho Boo Sungho Shin Wonyong Sung MQ 50 8 0 31 May 2020
Cross-filter compression for CNN inference acceleration Fuyuan Lyu Shien Zhu Weichen Liu MQ 20 0 0 18 May 2020
Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers Junjie Liu Zhe Xu Runbin Shi R. Cheung Hayden Kwok-Hay So 17 119 0 14 May 2020
Binarizing MobileNet via Evolution-based Searching Hai T. Phan Zechun Liu Dang T. Huynh Marios Savvides Kwang-Ting Cheng Zhiqiang Shen 3DV MQ 32 43 0 13 May 2020
Data-Free Network Quantization With Adversarial Knowledge Distillation Yoojin Choi Jihwan P. Choi Mostafa El-Khamy Jungwon Lee MQ 27 120 0 08 May 2020
SmartExchange: Trading Higher-cost Memory Storage/Access for Lower-cost Computation Yang Zhao Xiaohan Chen Yue Wang Chaojian Li Haoran You Y. Fu Yuan Xie Zhangyang Wang Yingyan Lin MQ 40 43 0 07 May 2020
MuBiNN: Multi-Level Binarized Recurrent Neural Network for EEG signal Classification Seyed Ahmad Mirsalari Sima Sinaei M. Salehi Masoud Daneshtalab MQ 16 5 0 19 Apr 2020
Dithered backprop: A sparse and quantized backpropagation algorithm for more efficient deep neural network training Simon Wiedemann Temesgen Mehari Kevin Kepp Wojciech Samek 32 18 0 09 Apr 2020