Adaptive Quantization for Deep Neural Network

4 December 2017

Yiren Zhou

Seyed-Mohsen Moosavi-Dezfooli

Ngai-man Cheung

P. Frossard

ArXiv PDF HTML

Papers citing "Adaptive Quantization for Deep Neural Network"

35 / 35 papers shown

Title
FiGKD: Fine-Grained Knowledge Distillation via High-Frequency Detail Transfer Seonghak Kim 19 0 0 17 May 2025
LPViT: Low-Power Semi-structured Pruning for Vision Transformers Kaixin Xu Zhe Wang Chunyun Chen Xue Geng Jie Lin Xulei Yang Min-man Wu Min Wu Xiaoli Li Weisi Lin ViT VLM 56 7 0 02 Jul 2024
Maximizing Discrimination Capability of Knowledge Distillation with Energy Function Seonghak Kim Gyeongdo Ham Suin Lee Donggon Jang Daeshik Kim 39 4 0 24 Nov 2023
Pursing the Sparse Limitation of Spiking Deep Learning Structures Hao-Ran Cheng Jiahang Cao Erjia Xiao Mengshu Sun Le Yang Jize Zhang Xue Lin B. Kailkhura Kaidi Xu Renjing Xu 29 1 0 18 Nov 2023
MBQuant: A Novel Multi-Branch Topology Method for Arbitrary Bit-width Network Quantization Mingliang Xu Yuyao Zhou Rongrong Ji Rongrong Ji MQ 39 1 0 14 May 2023
Evil from Within: Machine Learning Backdoors through Hardware Trojans Alexander Warnecke Julian Speith Janka Möller Konrad Rieck C. Paar AAML 29 3 0 17 Apr 2023
Efficient and Effective Methods for Mixed Precision Neural Network Quantization for Faster, Energy-efficient Inference Deepika Bablani J. McKinstry S. K. Esser R. Appuswamy D. Modha MQ 28 4 0 30 Jan 2023
BiMLP: Compact Binary Architectures for Vision Multi-Layer Perceptrons Yixing Xu Xinghao Chen Yunhe Wang MQ 32 8 0 29 Dec 2022
Edge-MultiAI: Multi-Tenancy of Latency-Sensitive Deep Learning Applications on Edge S. Zobaed Ali Mokhtari J. Champati M. Kourouma M. Salehi 21 9 0 14 Nov 2022
AskewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks Louis Leconte S. Schechtman Eric Moulines 34 4 0 07 Nov 2022
Analysis of Quantization on MLP-based Vision Models Lingran Zhao Zhen Dong Kurt Keutzer MQ 32 7 0 14 Sep 2022
Anytime-Lidar: Deadline-aware 3D Object Detection Ahmet Soyyigit Shuochao Yao H. Yun 3DPC 16 9 0 25 Aug 2022
Mixed-Precision Neural Networks: A Survey M. Rakka M. Fouda Pramod P. Khargonekar Fadi J. Kurdahi MQ 36 11 0 11 Aug 2022
Differential Privacy: What is all the noise about? Roxana Dánger Mercaderes 43 3 0 19 May 2022
Data-Free Knowledge Transfer: A Survey Yuang Liu Wei Zhang Jun Wang Jianyong Wang 40 48 0 31 Dec 2021
Automatic Mixed-Precision Quantization Search of BERT Changsheng Zhao Ting Hua Yilin Shen Qian Lou Hongxia Jin MQ 25 19 0 30 Dec 2021
Multi-Modality Distillation via Learning the teacher's modality-level Gram Matrix Peng Liu 24 0 0 21 Dec 2021
Understanding and Overcoming the Challenges of Efficient Transformer Quantization Yelysei Bondarenko Markus Nagel Tijmen Blankevoort MQ 25 133 0 27 Sep 2021
Quantized Convolutional Neural Networks Through the Lens of Partial Differential Equations Ido Ben-Yair Gil Ben Shalom Moshe Eliasof Eran Treister MQ 41 5 0 31 Aug 2021
HAO: Hardware-aware neural Architecture Optimization for Efficient Inference Zhen Dong Yizhao Gao Qijing Huang J. Wawrzynek Hayden Kwok-Hay So Kurt Keutzer 24 35 0 26 Apr 2021
Random and Adversarial Bit Error Robustness: Energy-Efficient and Secure DNN Accelerators David Stutz Nandhini Chandramoorthy Matthias Hein Bernt Schiele AAML MQ 30 18 0 16 Apr 2021
Direct Quantization for Training Highly Accurate Low Bit-width Deep Neural Networks Ziquan Liu Wuguannan Yao Qiao Li Antoni B. Chan MQ 30 9 0 26 Dec 2020
An SMT-Based Approach for Verifying Binarized Neural Networks Guy Amir Haoze Wu Clark W. Barrett Guy Katz 27 58 0 05 Nov 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 44 79 0 17 Sep 2020
MINT: Deep Network Compression via Mutual Information-based Neuron Trimming Madan Ravi Ganesh Jason J. Corso Salimeh Yasaei Sekeh MQ 50 15 0 18 Mar 2020
ZeroQ: A Novel Zero Shot Quantization Framework Yaohui Cai Z. Yao Zhen Dong A. Gholami Michael W. Mahoney Kurt Keutzer MQ 43 389 0 01 Jan 2020
Mixed-Precision Quantized Neural Network with Progressively Decreasing Bitwidth For Image Classification and Object Detection Tianshu Chu Qin Luo Jie Yang Xiaolin Huang MQ 24 6 0 29 Dec 2019
Loss Aware Post-training Quantization Yury Nahshan Brian Chmiel Chaim Baskin Evgenii Zheltonozhskii Ron Banner A. Bronstein A. Mendelson MQ 42 165 0 17 Nov 2019
HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networks Zhen Dong Z. Yao Yaohui Cai Daiyaan Arfeen A. Gholami Michael W. Mahoney Kurt Keutzer MQ 50 275 0 10 Nov 2019
Extremely Small BERT Models from Mixed-Vocabulary Training Sanqiang Zhao Raghav Gupta Yang Song Denny Zhou VLM 19 53 0 25 Sep 2019
Dataflow-based Joint Quantization of Weights and Activations for Deep Neural Networks Xue Geng Jie Fu Bin Zhao Jie Lin M. Aly C. Pal V. Chandrasekhar MQ 24 5 0 04 Jan 2019
Training Competitive Binary Neural Networks from Scratch Joseph Bethge Marvin Bornstein Adrian Loy Haojin Yang Christoph Meinel MQ 13 33 0 05 Dec 2018
A Survey on Methods and Theories of Quantized Neural Networks Yunhui Guo MQ 40 232 0 13 Aug 2018
On the Universal Approximability and Complexity Bounds of Quantized ReLU Neural Networks Yukun Ding Jinglan Liu Jinjun Xiong Yiyu Shi MQ 37 21 0 10 Feb 2018
MatConvNet - Convolutional Neural Networks for MATLAB Andrea Vedaldi Karel Lenc 192 2,946 0 15 Dec 2014