AdderNet: Do We Really Need Multiplications in Deep Learning?

31 December 2019

Papers citing "AdderNet: Do We Really Need Multiplications in Deep Learning?"

50 / 89 papers shown

Title
Compound and Parallel Modes of Tropical Convolutional Neural Networks Mingbo Li Liying Liu Ye Luo 35 0 0 09 Apr 2025
Lightweight Design and Optimization methods for DCNNs: Progress and Futures Hanhua Long Wenbin Bi Jian Sun 85 0 0 22 Dec 2024
Fast and Slow Gradient Approximation for Binary Neural Network Optimization Xinquan Chen Junqi Gao Biqing Qi Dong Li Yiang Luo Fangyuan Li Pengfei Li MQ 78 0 0 16 Dec 2024
Metric as Transform: Exploring beyond Affine Transform for Interpretable Neural Network Suman Sapkota 25 0 0 21 Oct 2024
Differentiable Weightless Neural Networks Alan T. L. Bacellar Zachary Susskind Mauricio Breternitz Jr. E. John L. John P. Lima F. M. G. França 30 3 0 14 Oct 2024
NASH: Neural Architecture and Accelerator Search for Multiplication-Reduced Hybrid Models Yang Xu Huihong Shi Zhongfeng Wang 45 0 0 07 Sep 2024
ShiftAddAug: Augment Multiplication-Free Tiny Neural Network with Hybrid Computation Yipin Guo Zihao Li Yilin Lang Qinyuan Ren 63 0 0 03 Jul 2024
ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization Haoran You Yipin Guo Yichao Fu Wei Zhou Huihong Shi Xiaofan Zhang Souvik Kundu Amir Yazdanbakhsh Y. Lin KELM 56 7 0 10 Jun 2024
Scalable MatMul-free Language Modeling Rui-Jie Zhu Yu Zhang Ethan Sifferman Tyler Sheaves Yiqiao Wang Dustin Richmond P. Zhou Jason Eshraghian 31 17 0 04 Jun 2024
BOLD: Boolean Logic Deep Learning Van Minh Nguyen Cristian Ocampo Aymen Askri Louis Leconte Ba-Hien Tran AI4CE 40 0 0 25 May 2024
Anole: Adapting Diverse Compressed Models For Cross-Scene Prediction On Mobile Devices Yunzhe Li Hongzi Zhu Zhuohong Deng Yunlong Cheng Liang Zhang Shan Chang Minyi Guo 31 0 0 09 May 2024
Lightweight Deep Learning for Resource-Constrained Environments: A Survey Hou-I Liu Marco Galindo Hongxia Xie Lai-Kuan Wong Hong-Han Shuai Yung-Hui Li Wen-Huang Cheng 58 48 0 08 Apr 2024
Rewrite the Stars Xu Ma Xiyang Dai Yue Bai Yizhou Wang Yun Fu 44 95 0 29 Mar 2024
A&B BNN: Add&Bit-Operation-Only Hardware-Friendly Binary Neural Network Ruichen Ma G. Qiao Yián Liu L. Meng N. Ning Yang Liu Shaogang Hu AAML MQ 42 3 0 06 Mar 2024
Outlier-Aware Training for Low-Bit Quantization of Structural Re-Parameterized Networks Muqun Niu Yuan Ren Boyu Li Chenchen Ding BDL MQ 25 0 0 11 Feb 2024
Robustness to distribution shifts of compressed networks for edge devices Lulan Shen Ali Edalati Brett H. Meyer Warren Gross James J. Clark 33 0 0 22 Jan 2024
Regularized PolyKervNets: Optimizing Expressiveness and Efficiency for Private Inference in Deep Neural Networks Toluwani Aremu 25 0 0 23 Dec 2023
Boolean Variation and Boolean Logic BackPropagation Van Minh Nguyen 27 1 0 13 Nov 2023
Going Beyond Neural Network Feature Similarity: The Network Feature Complexity and Its Interpretation Using Category Theory Yiting Chen Zhanpeng Zhou Junchi Yan 20 9 0 10 Oct 2023
Ternary Singular Value Decomposition as a Better Parameterized Form in Linear Mapping Boyu Chen Hanxuan Chen Jiao He Fengyu Sun Shangling Jui 51 3 0 15 Aug 2023
GraPhSyM: Graph Physical Synthesis Model Ahmed A. Agiza Rajarshi Roy Teodor-Dumitru Ene Saad Godil Sherief Reda Bryan Catanzaro 11 3 0 07 Aug 2023
A Survey of Techniques for Optimizing Transformer Inference Krishna Teja Chitty-Venkata Sparsh Mittal M. Emani V. Vishwanath Arun Somani 43 62 0 16 Jul 2023
ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer Haoran You Huihong Shi Yipin Guo Yingyan Lin Lin 34 16 0 10 Jun 2023
Multiplication-Free Transformer Training via Piecewise Affine Operations Atli Kosson Martin Jaggi 16 4 0 26 May 2023
PQA: Exploring the Potential of Product Quantization in DNN Hardware Acceleration Ahmed F. AbouElhamayed Angela Cui Javier Fernandez-Marques Nicholas D. Lane Mohamed S. Abdelfattah MQ 23 4 0 25 May 2023
Revisiting Data Augmentation in Model Compression: An Empirical and Comprehensive Study Muzhou Yu Linfeng Zhang Kaisheng Ma 23 2 0 22 May 2023
DietCNN: Multiplication-free Inference for Quantized CNNs Swarnava Dey P. Dasgupta P. Chakrabarti MQ 50 1 0 09 May 2023
A Framework for Analyzing Cross-correlators using Price's Theorem and Piecewise-Linear Decomposition Zhili Xiao S. Chakrabartty 14 1 0 18 Apr 2023
Dynamic Mobile-Former: Strengthening Dynamic Convolution with Attention and Residual Connection in Kernel Space Seokju Yun Youngmin Ro ViT 27 2 0 13 Apr 2023
A Heterogeneous Parallel Non-von Neumann Architecture System for Accurate and Efficient Machine Learning Molecular Dynamics Zhuoying Zhao Ziling Tan Pinghui Mo Xiaonan Wang Dan Zhao Xin Zhang Ming Tao Jie Liu 24 1 0 26 Mar 2023
Toward DNN of LUTs: Learning Efficient Image Restoration with Multiple Look-Up Tables Jiacheng Li C. Chen Zhen Cheng Zhiwei Xiong 36 10 0 25 Mar 2023
Evaluation of Convolution Primitives for Embedded Neural Networks on 32-bit Microcontrollers Baptiste Nguyen Pierre-Alain Moëllic Sylvain Blayac 11 2 0 19 Mar 2023
Ultra-low Precision Multiplication-free Training for Deep Neural Networks Chang-Shu Liu Rui Zhang Xishan Zhang Yifan Hao Zidong Du Xingui Hu Ling Li Qi Guo MQ 34 1 0 28 Feb 2023
EuclidNets: An Alternative Operation for Efficient Inference of Deep Learning Models Xinlin Li Mariana Parazeres Adam M. Oberman Alireza Ghaffari M. Asgharian V. Nia 40 4 0 22 Dec 2022
Redistribution of Weights and Activations for AdderNet Quantization Ying Nie Kai Han Haikang Diao Chuanjian Liu Enhua Wu Yunhe Wang MQ 55 6 0 20 Dec 2022
Hoyer regularizer is all you need for ultra low-latency spiking neural networks Gourav Datta Zeyu Liu P. Beerel 30 9 0 20 Dec 2022
NASA: Neural Architecture Search and Acceleration for Hardware Inspired Hybrid Networks Huihong Shi Haoran You Yang Katie Zhao Zhongfeng Wang Yingyan Lin 64 7 0 24 Oct 2022
Margin-Based Few-Shot Class-Incremental Learning with Class-Level Overfitting Mitigation Yixiong Zou Shanghang Zhang Yuhua Li Rui Li CLL 18 60 0 10 Oct 2022
DenseShift: Towards Accurate and Efficient Low-Bit Power-of-Two Quantization Xinlin Li Bangya Liu Ruizhi Yang Vanessa Courville Chao Xing V. Nia MQ 34 2 0 20 Aug 2022
AdaBin: Improving Binary Neural Networks with Adaptive Binary Sets Zhaopeng Tu Xinghao Chen Pengju Ren Yunhe Wang MQ 36 54 0 17 Aug 2022
PECAN: A Product-Quantized Content Addressable Memory Network Jie Ran R. Lin Jason Chun Lok Li Jiajun Zhou Ngai Wong MQ 46 7 0 13 Aug 2022
Lightweight Vision Transformer with Cross Feature Attention Youpeng Zhao Huadong Tang Yingying Jiang A. Yong Qiang Wu ViT 22 10 0 15 Jul 2022
Universal Learned Image Compression With Low Computational Cost Bowen Li Xin Yao Youneng Bao Fanyang Meng Yongsheng Liang Wen-Tao Tan 43 0 0 23 Jun 2022
DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks Y. Fu Haichuan Yang Jiayi Yuan Meng Li Cheng Wan Raghuraman Krishnamoorthi Vikas Chandra Yingyan Lin 30 18 0 02 Jun 2022
MoCoViT: Mobile Convolutional Vision Transformer Hailong Ma Xin Xia Xing Wang Xuefeng Xiao Jiashi Li Min Zheng ViT 37 18 0 25 May 2022
ShiftAddNAS: Hardware-Inspired Search for More Accurate and Efficient Neural Networks Haoran You Baopu Li Huihong Shi Y. Fu Yingyan Lin 49 17 0 17 May 2022
Attention Mechanism with Energy-Friendly Operations Boyi Deng Baosong Yang Dayiheng Liu Rong Xiao Derek F. Wong Haibo Zhang Boxing Chen Lidia S. Chao MU 113 1 0 28 Apr 2022
TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation Wenqiang Zhang Zilong Huang Guozhong Luo Tao Chen Xinggang Wang Wenyu Liu Gang Yu Chunhua Shen ViT 22 199 0 12 Apr 2022
ShiftNAS: Towards Automatic Generation of Advanced Mulitplication-Less Neural Networks Xiaoxuan Lou Guowen Xu Kangjie Chen Guanlin Li Jiwei Li Tianwei Zhang OOD MQ 32 0 0 07 Apr 2022
Energy awareness in low precision neural networks Nurit Spingarn-Eliezer Ron Banner Elad Hoffer Hilla Ben-Yaacov T. Michaeli 38 0 0 06 Feb 2022