Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation

12 April 2023

Gang Pan

Papers citing "Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillation"

38 / 38 papers shown

Title
Bridging Quantized Artificial Neural Networks and Neuromorphic Hardware Zhenhui Chen Haoran Xu De Ma 2 0 0 18 May 2025
TS-SNN: Temporal Shift Module for Spiking Neural Networks Kairong Yu Tianqing Zhang Qi Xu Gang Pan Hongwei Wang 168 0 0 07 May 2025
SOTA: Spike-Navigated Optimal TrAnsport Saliency Region Detection in Composite-bias Videos Wenxuan Liu Yao Deng Kang Chen Xian Zhong Zhaofei Yu Tiejun Huang 27 0 0 01 May 2025
Head-Tail-Aware KL Divergence in Knowledge Distillation for Spiking Neural Networks Tianqing Zhang Zixin Zhu Kairong Yu Hongwei Wang 175 0 0 29 Apr 2025
Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement Shu Yang Chao Yu Lei Liu Hanzhi Ma Aili Wang Erping Li 47 0 0 20 Mar 2025
Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks Kairong Yu Chengting Yu Tianqing Zhang Xiaochen Zhao Shu Yang Hongwei Wang Qiang Zhang Qi Xu 71 3 0 05 Mar 2025
CLIF: Complementary Leaky Integrate-and-Fire Neuron for Spiking Neural Networks Yulong Huang Xiaopeng Lin Hongwei Ren Haotian Fu Yue Zhou Zunchang Liu Biao Pan Bojun Cheng 57 10 0 20 Feb 2025
DA-LIF: Dual Adaptive Leaky Integrate-and-Fire Model for Deep Spiking Neural Networks Tianqing Zhang Kairong Yu Jian Zhang Hongwei Wang AI4CE 43 1 0 05 Feb 2025
FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networks Kairong Yu Tianqing Zhang Hongwei Wang Qi Xu 36 2 0 15 Dec 2024
Twin Network Augmentation: A Novel Training Strategy for Improved Spiking Neural Networks and Efficient Weight Quantization Lucas Deckers Benjamin Vandersmissen Ing Jyh Tsang W. V. Leekwijck Steven Latré MQ 30 2 0 24 Sep 2024
Computer Vision Model Compression Techniques for Embedded Systems: A Survey Alexandre Lopes Fernando Pereira dos Santos D. Oliveira Mauricio Schiezaro Hélio Pedrini 34 5 0 15 Aug 2024
BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blurred Knowledge Distillation Zekai Xu Kang You Qinghai Guo Xiang Wang Zhezhi He 36 3 0 12 Jul 2024
On Reducing Activity with Distillation and Regularization for Energy Efficient Spiking Neural Networks Thomas Louis Benoit Miramond Alain Pegatoquet Adrien Girard 30 0 0 26 Jun 2024
Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition Yang Wang Haiyang Mei Qirui Bao Ziqi Wei Mike Zheng Shou Haizhou Li Bo Dong Xin Yang 46 1 0 20 Jun 2024
Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural Networks Lin Zuo Yongqi Ding Mengmeng Jing Kunshan Yang Yunqian Yu 54 3 0 12 Jun 2024
Toward Efficient Deep Spiking Neuron Networks:A Survey On Compression Hui Xie Ge Yang Wenjuan Gao 43 1 0 03 Jun 2024
Robust Stable Spiking Neural Networks Jianhao Ding Zhiyu Pan Yujia Liu Zhaofei Yu Tiejun Huang AAML 38 5 0 31 May 2024
Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs Zhipeng Huang Jianhao Ding Zhiyu Pan Haoran Li Ying Fang Zhaofei Yu Jian K. Liu 37 0 0 26 Apr 2024
Fourier Prompt Tuning for Modality-Incomplete Scene Segmentation Ruiping Liu Jiaming Zhang Kunyu Peng Yufan Chen Ke Cao Junwei Zheng M. Sarfraz Kailun Yang Rainer Stiefelhagen VLM 42 8 0 30 Jan 2024
LitE-SNN: Designing Lightweight and Efficient Spiking Neural Network through Spatial-Temporal Compressive Network Search and Joint Optimization Qianhui Liu Jiaqi Yan Malu Zhang Gang Pan Haizhou Li 42 4 0 26 Jan 2024
TT-SNN: Tensor Train Decomposition for Efficient Spiking Neural Network Training Donghyun Lee Ruokai Yin Youngeun Kim Abhishek Moitra Yuhang Li Priyadarshini Panda 21 3 0 15 Jan 2024
Take A Shortcut Back: Mitigating the Gradient Vanishing for Training Spiking Neural Networks Yu-Zhu Guo Y. Chen 26 2 0 09 Jan 2024
Enhancing Adaptive History Reserving by Spiking Convolutional Block Attention Module in Recurrent Neural Networks Qi Xu Yuyuan Gao Jiangrong Shen Yaxin Li Xuming Ran Huajin Tang Gang Pan 94 14 0 08 Jan 2024
Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks Yu-Zhu Guo Y. Chen Xiaode Liu Weihang Peng Yuhan Zhang Xuhui Huang Zhe Ma 33 28 0 11 Dec 2023
Spiking PointNet: Spiking Neural Networks for Point Clouds Dayong Ren Zhe Ma Y. Chen Weihang Peng Xiaode Liu Yuhan Zhang Yu-Zhu Guo 3DH 3DPC 20 23 0 10 Oct 2023
Rotation Augmented Distillation for Exemplar-Free Class Incremental Learning with Detailed Analysis Xiu-yan Chen Xiaobin Chang CLL 26 0 0 29 Aug 2023
SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation Malyaban Bal Abhronil Sengupta 30 42 0 21 Aug 2023
Membrane Potential Batch Normalization for Spiking Neural Networks Yu-Zhu Guo Yuhan Zhang Y. Chen Weihang Peng Xiaode Liu Liwen Zhang Xuhui Huang Zhe Ma AAML 32 37 0 16 Aug 2023
RMP-Loss: Regularizing Membrane Potential Distribution for Spiking Neural Networks Yu-Zhu Guo Xiaode Liu Y. Chen Liwen Zhang Weihang Peng Yuhan Zhang Xuhui Huang Zhe Ma AAML MQ 49 23 0 13 Aug 2023
Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks Xuerui Qiu Rui-Jie Zhu Yuhong Chou Zhaorui Wang Liang-Jian Deng Guoqi Li 34 29 0 12 Aug 2023
Direct Learning-Based Deep Spiking Neural Networks: A Review Yu-Zhu Guo Xuhui Huang Zhe Ma AI4CE 77 47 0 31 May 2023
Biologically inspired structure learning with reverse knowledge distillation for spiking neural networks Qi Xu Yaxin Li Xuanye Fang Jiangrong Shen Jian K. Liu Huajin Tang Gang Pan 19 15 0 19 Apr 2023
SEENN: Towards Temporal Spiking Early-Exit Neural Networks Yuhang Li Tamar Geller Youngeun Kim Priyadarshini Panda 24 38 0 02 Apr 2023
Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks Tong Bu Wei Fang Jianhao Ding Penglin Dai Zhaofei Yu Tiejun Huang 110 196 0 08 Mar 2023
Spiking Neural Networks for Frame-based and Event-based Single Object Localization Sami Barchid José Mennesson J. Eshraghian Chaabane Djéraba Bennamoun 33 29 0 13 Jun 2022
Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks Shi-Wee Deng Shi Gu 121 200 0 28 Feb 2021
Deep Residual Learning in Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen Tiejun Huang T. Masquelier Yonghong Tian 123 479 0 08 Feb 2021
Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation Nitin Rathi G. Srinivasan Priyadarshini Panda Kaushik Roy 124 294 0 04 May 2020