Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting

24 February 2022

Shi-Wee Deng

Yuhang Li

Shanghang Zhang

Shi Gu

ArXiv PDF HTML

Papers citing "Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting"

50 / 152 papers shown

Title
ILIF: Temporal Inhibitory Leaky Integrate-and-Fire Neuron for Overactivation in Spiking Neural Networks Kai Sun Peibo Duan Levin Kuhlmann Beilun Wang Bin Zhang 19 0 0 15 May 2025
Self-cross Feature based Spiking Neural Networks for Efficient Few-shot Learning Qi Xu J. Zhu D. Zhou Hao Chen Y. Liu Jiangrong Shen Qiang Zhang 26 0 0 12 May 2025
TS-SNN: Temporal Shift Module for Spiking Neural Networks Kairong Yu Tianqing Zhang Qi Xu Gang Pan Hongwei Wang 135 0 0 07 May 2025
PASCAL: Precise and Efficient ANN- SNN Conversion using Spike Accumulation and Adaptive Layerwise Activation Pranav Ramesh Gopalakrishnan Srinivasan 31 0 0 03 May 2025
Head-Tail-Aware KL Divergence in Knowledge Distillation for Spiking Neural Networks Tianqing Zhang Zixin Zhu Kairong Yu Hongwei Wang 136 0 0 29 Apr 2025
Decision SpikeFormer: Spike-Driven Transformer for Decision Making Wei Huang Qinying Gu Nanyang Ye OffRL 29 1 0 04 Apr 2025
A 71.2- $μ$ W Speech Recognition Accelerator with Recurrent Spiking Neural Network Chih-Chyau Yang Tian-Sheuan Chang 60 1 0 27 Mar 2025
SpiLiFormer: Enhancing Spiking Transformers with Lateral Inhibition Zeqi Zheng Yanchen Huang Yingchao Yu Zizheng Zhu Junfeng Tang Zhaofei Yu Yaochu Jin 39 0 0 20 Mar 2025
Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement Shu Yang C. Yu Lei Liu Hanzhi Ma Aili Wang Erping Li 42 0 0 20 Mar 2025
Temporal Flexibility in Spiking Neural Networks: Towards Generalization Across Time Steps and Deployment Friendliness Kangrui Du Yuhang Wu Shikuang Deng Shi Gu 38 0 0 18 Mar 2025
DTA: Dual Temporal-channel-wise Attention for Spiking Neural Networks Minje Kim Minjun Kim Xu Yang 36 0 0 13 Mar 2025
Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks Kairong Yu Chengting Yu Tianqing Zhang Xiaochen Zhao Shu Yang Hongwei Wang Qiang Zhang Qi Xu 66 3 0 05 Mar 2025
Towards Effective and Sparse Adversarial Attack on Spiking Neural Networks via Breaking Invisible Surrogate Gradients Li Lun Kunyu Feng Qinglong Ni Ling Liang Yuan Wang Ying Li Dunshan Yu Xiaoxin Cui AAML 76 0 0 05 Mar 2025
STAA-SNN: Spatial-Temporal Attention Aggregator for Spiking Neural Networks Tianqing Zhang Kairong Yu Xian Zhong Hongwei Wang Qi Xu Qiang Zhang 86 1 0 04 Mar 2025
Spiking Transformer:Introducing Accurate Addition-Only Spiking Self-Attention for Transformer Yufei Guo Xiaode Liu Y. Chen Weihang Peng Yuhan Zhang Zhe Ma MQ 43 0 0 28 Feb 2025
Memory-Free and Parallel Computation for Quantized Spiking Neural Networks Dehao Zhang Shuai Wang Yichen Xiao Wenjie Wei Yimeng Shan Malu Zhang Y. Yang MQ 41 0 0 25 Feb 2025
Towards Accurate Binary Spiking Neural Networks: Learning with Adaptive Gradient Modulation Mechanism Yu Liang Wenjie Wei A. Belatreche Honglin Cao Zijian Zhou Shuai Wang Malu Zhang Y. Yang MQ 61 0 0 21 Feb 2025
CLIF: Complementary Leaky Integrate-and-Fire Neuron for Spiking Neural Networks Yulong Huang Xiaopeng Lin Hongwei Ren Haotian Fu Yue Zhou Zunchang Liu Biao Pan Bojun Cheng 57 9 0 20 Feb 2025
On the Privacy Risks of Spiking Neural Networks: A Membership Inference Analysis Junyi Guan Abhijith Sharma Chong Tian Salem Lahlou AAML 49 1 0 18 Feb 2025
Spiking Neural Network Feature Discrimination Boosts Modality Fusion Katerina Maria Oikonomou Ioannis Kansizoglou Antonios Gasteratos 41 0 0 05 Feb 2025
DA-LIF: Dual Adaptive Leaky Integrate-and-Fire Model for Deep Spiking Neural Networks Tianqing Zhang Kairong Yu Jian Zhang Hongwei Wang AI4CE 35 1 0 05 Feb 2025
TESS: A Scalable Temporally and Spatially Local Learning Rule for Spiking Neural Networks M. Apolinario Kaushik Roy Charlotte Frenkel 89 0 0 03 Feb 2025
Time-independent Spiking Neuron via Membrane Potential Estimation for Efficient Spiking Neural Networks Hanqi Chen Lixing Yu Shaojie Zhan Penghui Yao Jiankun Shao 42 1 0 31 Dec 2024
Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Network Z. Wang Yuetong Fang Jiahang Cao Hongwei Ren Renjing Xu 77 2 0 18 Dec 2024
Faster and Stronger: When ANN-SNN Conversion Meets Parallel Spiking Calculation Zecheng Hao Zhaofei Yu Tiejun Huang 69 0 0 18 Dec 2024
FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networks Kairong Yu Tianqing Zhang Hongwei Wang Qi Xu 26 1 0 15 Dec 2024
Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Training Man Yao Xuerui Qiu Tianxiang Hu J. Hu Yuhong Chou Keyu Tian Jianxing Liao Luziwei Leng Bo Xu Guoqi Li 76 4 0 25 Nov 2024
STOP: Spatiotemporal Orthogonal Propagation for Weight-Threshold-Leakage Synergistic Training of Deep Spiking Neural Networks Haoran Gao Xichuan Zhou Yingcheng Lin Min Tian Liyuan Liu Cong Shi 31 0 0 17 Nov 2024
Neuromorphic Wireless Split Computing with Multi-Level Spikes Dengyu Wu Jiechen Chen Bipin Rajendran H. Vincent Poor Osvaldo Simeone 44 1 0 07 Nov 2024
Flashy Backdoor: Real-world Environment Backdoor Attack on SNNs with DVS Cameras Roberto Riaño Gorka Abad S. Picek A. Urbieta AAML 33 0 0 05 Nov 2024
Spatial-Temporal Search for Spiking Neural Networks Kaiwei Che Zhaokun Zhou Li-xin Yuan Jianguo Zhang Yonghong Tian Luziwei Leng 32 0 0 24 Oct 2024
Spiking Transformer with Spatial-Temporal Attention Donghyun Lee Yuhang Li Youngeun Kim Shiting Xiao Priyadarshini Panda 28 1 0 29 Sep 2024
Twin Network Augmentation: A Novel Training Strategy for Improved Spiking Neural Networks and Efficient Weight Quantization Lucas Deckers Benjamin Vandersmissen Ing Jyh Tsang W. V. Leekwijck Steven Latré MQ 25 2 0 24 Sep 2024
DS2TA: Denoising Spiking Transformer with Attenuated Spatiotemporal Attention Boxun Xu Hejia Geng Yuxuan Yin Peng Li AI4TS 26 0 0 20 Sep 2024
Towards Low-latency Event-based Visual Recognition with Hybrid Step-wise Distillation Spiking Neural Networks X. Zhong Shengwang Hu Wenxuan Liu Wenxin Huang Jianhao Ding Zhaofei Yu Tiejun Huang 34 4 0 19 Sep 2024
ReSpike: Residual Frames-based Hybrid Spiking Neural Networks for Efficient Action Recognition Shiting Xiao Yuhang Li Youngeun Kim Donghyun Lee Priyadarshini Panda 36 1 0 03 Sep 2024
Spiking Diffusion Models Jiahang Cao Hanzhong Guo Ziqing Wang Deming Zhou Hao Cheng Qiang Zhang Renjing Xu DiffM 43 3 0 29 Aug 2024
RSC-SNN: Exploring the Trade-off Between Adversarial Robustness and Accuracy in Spiking Neural Networks via Randomized Smoothing Coding Keming Wu Man Yao Yuhong Chou Xuerui Qiu Rui Yang Boxing Xu Guoqi Li AAML 23 4 0 29 Jul 2024
BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blurred Knowledge Distillation Zekai Xu Kang You Qinghai Guo Xiang Wang Zhezhi He 28 3 0 12 Jul 2024
Multi-Bit Mechanism: A Novel Information Transmission Paradigm for Spiking Neural Networks Yongjun Xiao Xianlong Tian Yongqi Ding Pei He Mengmeng Jing Lin Zuo MQ 27 1 0 08 Jul 2024
Directly Training Temporal Spiking Neural Network with Sparse Surrogate Gradient Yang Li Feifei Zhao Dongcheng Zhao Yi Zeng 42 2 0 28 Jun 2024
Apprenticeship-Inspired Elegance: Synergistic Knowledge Distillation Empowers Spiking Neural Networks for Efficient Single-Eye Emotion Recognition Yang Wang Haiyang Mei Qirui Bao Ziqi Wei Mike Zheng Shou Haizhou Li Bo Dong Xin Yang 46 0 0 20 Jun 2024
Evolutionary Spiking Neural Networks: A Survey Shuaijie Shen Rui Zhang Chao Wang Renzhuo Huang Aiersi Tuerhong Qinghai Guo Zhichao Lu Jianguo Zhang Luziwei Leng 24 6 0 18 Jun 2024
ED-sKWS: Early-Decision Spiking Neural Networks for Rapid,and Energy-Efficient Keyword Spotting Zeyang Song Qianhui Liu Qu Yang Yizhou Peng Haizhou Li 23 0 0 14 Jun 2024
Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural Networks Lin Zuo Yongqi Ding Mengmeng Jing Kunshan Yang Yunqian Yu 46 3 0 12 Jun 2024
NeuroMoCo: A Neuromorphic Momentum Contrast Learning Method for Spiking Neural Networks Yuqi Ma Huamin Wang Hangchi Shen Xuemei Chen Shukai Duan Shiping Wen 54 0 0 10 Jun 2024
Spiking Neural Networks with Consistent Mapping Relations Allow High-Accuracy Inference Yang Li Xiang-Yu He Qingqun Kong Yi Zeng 32 0 0 08 Jun 2024
Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning Yaxin Li Qi Xu Jiangrong Shen Hongming Xu Long Chen Gang Pan 38 5 0 03 Jun 2024
Autaptic Synaptic Circuit Enhances Spatio-temporal Predictive Learning of Spiking Neural Networks Lihao Wang Zhaofei Yu 42 5 0 01 Jun 2024
Robust Stable Spiking Neural Networks Jianhao Ding Zhiyu Pan Yujia Liu Zhaofei Yu Tiejun Huang AAML 33 5 0 31 May 2024