Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representation

1 May 2022

Papers citing "Training High-Performance Low-Latency Spiking Neural Networks by Differentiation on Spike Representation"

50 / 88 papers shown

Title
TDFormer: A Top-Down Attention-Controlled Spiking Transformer Zizheng Zhu Yingchao Yu Zeqi Zheng Zhaofei Yu Yaochu Jin 20 0 0 17 May 2025
ILIF: Temporal Inhibitory Leaky Integrate-and-Fire Neuron for Overactivation in Spiking Neural Networks Kai Sun Peibo Duan Levin Kuhlmann Beilun Wang Bin Zhang 57 0 0 15 May 2025
Revisiting Reset Mechanisms in Spiking Neural Networks for Sequential Modeling: Specialized Discretization for Binary Activated RNN Enqi Zhang MQ 306 0 0 24 Apr 2025
Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement Shu Yang Chao Yu Lei Liu Hanzhi Ma Aili Wang Erping Li 69 0 0 20 Mar 2025
On the Privacy-Preserving Properties of Spiking Neural Networks with Unique Surrogate Gradients and Quantization Levels Ayana Moshruba Shay Snyder Hamed Poursiami Maryam Parsa AAML 76 2 0 25 Feb 2025
CLIF: Complementary Leaky Integrate-and-Fire Neuron for Spiking Neural Networks Yulong Huang Xiaopeng Lin Hongwei Ren Haotian Fu Yue Zhou Zunchang Liu Biao Pan Bojun Cheng 62 11 0 20 Feb 2025
On the Privacy Risks of Spiking Neural Networks: A Membership Inference Analysis Junyi Guan Abhijith Sharma Chong Tian Salem Lahlou AAML 54 1 0 18 Feb 2025
TESS: A Scalable Temporally and Spatially Local Learning Rule for Spiking Neural Networks M. Apolinario Kaushik Roy Charlotte Frenkel 142 0 0 03 Feb 2025
Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Network Zehua Wang Yuetong Fang Jiahang Cao Hongwei Ren Renjing Xu 103 2 0 18 Dec 2024
FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networks Kairong Yu Tianqing Zhang Hongwei Wang Qi Xu 59 2 0 15 Dec 2024
Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Training Man Yao Xuerui Qiu Tianxiang Hu J. Hu Yuhong Chou Keyu Tian Jianxing Liao Luziwei Leng Bo Xu Guoqi Li 91 10 0 25 Nov 2024
Spiking Graph Neural Network on Riemannian Manifolds Li Sun Zhenhao Huang Qiqi Wan Hao Peng Philip S. Yu GNN AI4CE 37 2 0 23 Oct 2024
Advancing Training Efficiency of Deep Spiking Neural Networks through Rate-based Backpropagation Chengting Yu Lei Liu Gaoang Wang Erping Li Aili Wang 33 1 0 15 Oct 2024
Spiking Transformer with Spatial-Temporal Attention Donghyun Lee Yuhang Li Youngeun Kim Shiting Xiao Priyadarshini Panda 35 3 0 29 Sep 2024
A dynamic vision sensor object recognition model based on trainable event-driven convolution and spiking attention mechanism Peng Zheng Qian Zhou BDL 43 0 0 19 Sep 2024
Event Stream based Human Action Recognition: A High-Definition Benchmark Dataset and Algorithms Xiao Wang Shiao Wang Pengpeng Shao Bo Jiang Lin Zhu Yonghong Tian 232 2 0 19 Aug 2024
Online Pseudo-Zeroth-Order Training of Neuromorphic Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 47 0 0 17 Jul 2024
Directly Training Temporal Spiking Neural Network with Sparse Surrogate Gradient Yang Li Feifei Zhao Dongcheng Zhao Yi Zeng 52 2 0 28 Jun 2024
Retain, Blend, and Exchange: A Quality-aware Spatial-Stereo Fusion Approach for Event Stream Recognition Lan Chen Dong Li Xiao Wang Pengpeng Shao Wei Zhang Yaowei Wang Yonghong Tian Jin Tang 80 2 0 27 Jun 2024
SVFormer: A Direct Training Spiking Transformer for Efficient Video Action Recognition Liutao Yu Liwei Huang Chenlin Zhou Han Zhang Zhengyu Ma Huihui Zhou Yonghong Tian ViT 62 4 0 21 Jun 2024
Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural Networks Lin Zuo Yongqi Ding Mengmeng Jing Kunshan Yang Yunqian Yu 59 3 0 12 Jun 2024
NeuroMoCo: A Neuromorphic Momentum Contrast Learning Method for Spiking Neural Networks Yuqi Ma Huamin Wang Hangchi Shen Xuemei Chen Shukai Duan Shiping Wen 76 0 0 10 Jun 2024
SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms Xingrun Xing Zheng Zhang Ziyi Ni Shitao Xiao Yiming Ju Siqi Fan Yequan Wang Jiajun Zhang Guoqi Li 52 10 0 05 Jun 2024
Temporal Spiking Neural Networks with Synaptic Delay for Graph Reasoning Mingqing Xiao Yixin Zhu D.K. He Zhouchen Lin LRM 55 4 0 27 May 2024
High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost Jiakui Hu Man Yao Xuerui Qiu Yuhong Chou Yuxuan Cai Ning Qiao Yonghong Tian Boxing Xu Guoqi Li AI4CE 42 11 0 26 May 2024
Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods Chenlin Zhou Han Zhang Liutao Yu Yumin Ye Zhaokun Zhou Liwei Huang Zhengyu Ma Xiaopeng Fan Huihui Zhou Yonghong Tian 66 11 0 06 May 2024
Direct Training Needs Regularisation: Anytime Optimal Inference Spiking Neural Network Dengyu Wu Yi Qi Kaiwen Cai Gao Jin Xinping Yi Xiaowei Huang 48 3 0 15 Apr 2024
Continuous Spiking Graph Neural Networks Nan Yin Mengzhu Wang Li Shen Hitesh Laxmichand Patel Baopu Li Bin Gu Huan Xiong GNN 41 10 0 02 Apr 2024
FTBC: Forward Temporal Bias Correction for Optimizing ANN-SNN Conversion Xiaofeng Wu V. Bojkovic Bin Gu Kun Suo Kai Zou 48 3 0 27 Mar 2024
Fourier or Wavelet bases as counterpart self-attention in spikformer for efficient visual classification Qingyu Wang Duzhen Zhang Tilelin Zhang Bo Xu 39 1 0 27 Mar 2024
Spiking Wavelet Transformer Yuetong Fang Ziqing Wang Lingfeng Zhang Jiahang Cao Honglei Chen Renjing Xu 69 6 0 17 Mar 2024
EventRPG: Event Data Augmentation with Relevance Propagation Guidance Mingyuan Sun Donghao Zhang Zongyuan Ge Jiaxu Wang Jia Li Zheng Fang Renjing Xu 37 7 0 14 Mar 2024
Efficient Online Learning for Networks of Two-Compartment Spiking Neurons Yujia Yin Xinyi Chen Chenxiang Ma Jibin Wu Kay Chen Tan 60 0 0 25 Feb 2024
Hebbian Learning based Orthogonal Projection for Continual Learning of Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin CLL 60 7 0 19 Feb 2024
TIM: An Efficient Temporal Interaction Module for Spiking Transformer Sicheng Shen Dongcheng Zhao Guobin Shen Yi Zeng AI4TS 49 6 0 22 Jan 2024
Uncertainty-aware Bridge based Mobile-Former Network for Event-based Pattern Recognition Haoxiang Yang Chengguo Yuan Yabin Zhu Langlang Chen Tianlin Li Jin Tang 56 0 0 20 Jan 2024
LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Units Zeyu Liu Gourav Datta Anni Li Peter A. Beerel 40 9 0 20 Jan 2024
Take A Shortcut Back: Mitigating the Gradient Vanishing for Training Spiking Neural Networks Yu-Zhu Guo Y. Chen 31 3 0 09 Jan 2024
Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket Zhaokun Zhou Kaiwei Che Wei Fang Keyu Tian Yuesheng Zhu Shuicheng Yan Yonghong Tian Liuliang Yuan ViT 52 31 0 04 Jan 2024
Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Network Yongqi Ding Lin Zuo Mengmeng Jing Pei He Yongjun Xiao 45 16 0 02 Jan 2024
Memory-Efficient Reversible Spiking Neural Networks Hong Zhang Yu Zhang 33 9 0 13 Dec 2023
When Bio-Inspired Computing meets Deep Learning: Low-Latency, Accurate, & Energy-Efficient Spiking Neural Networks from Artificial Neural Networks Gourav Datta Zeyu Liu James Diffenderfer B. Kailkhura Peter A. Beerel 63 0 0 12 Dec 2023
Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks Yu-Zhu Guo Y. Chen Xiaode Liu Weihang Peng Yuhan Zhang Xuhui Huang Zhe Ma 41 28 0 11 Dec 2023
Spiking Neural Networks with Dynamic Time Steps for Vision Transformers Gourav Datta Zeyu Liu Anni Li Peter A. Beerel 53 1 0 28 Nov 2023
Pursing the Sparse Limitation of Spiking Deep Learning Structures Hao-Ran Cheng Jiahang Cao Erjia Xiao Mengshu Sun Le Yang Jize Zhang Xue Lin B. Kailkhura Kaidi Xu Renjing Xu 35 1 0 18 Nov 2023
Tensor Decomposition Based Attention Module for Spiking Neural Networks Haoyu Deng Rui-jie Zhu Xuerui Qiu Yule Duan Malu Zhang Liang-Jian Deng 42 13 0 23 Oct 2023
Spike-based Neuromorphic Computing for Next-Generation Computer Vision Md. Sakib Hasan Catherine D. Schuman Zhongyang Zhang Tauhidur Rahman Garrett S. Rose 53 0 0 15 Oct 2023
Spike Accumulation Forwarding for Effective Training of Spiking Neural Networks Ryuji Saiin Tomoya Shirakawa Sota Yoshihara Yoshihide Sawada Hiroyuki Kusumoto 27 1 0 04 Oct 2023
Event-Enhanced Multi-Modal Spiking Neural Network for Dynamic Obstacle Avoidance Yang Wang Bo Dong Yuji Zhang Yunduo Zhou Haiyang Mei Ziqi Wei Xin Yang 42 5 0 03 Oct 2023
RMP-Loss: Regularizing Membrane Potential Distribution for Spiking Neural Networks Yu-Zhu Guo Xiaode Liu Y. Chen Liwen Zhang Weihang Peng Yuhan Zhang Xuhui Huang Zhe Ma AAML MQ 54 23 0 13 Aug 2023