Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting

24 February 2022

Shi-Wee Deng

Yuhang Li

Shanghang Zhang

Shi Gu

ArXiv PDF HTML

Papers citing "Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting"

50 / 152 papers shown

Title
Enhancing Adversarial Robustness in SNNs with Sparse Gradients Yujia Liu Tong Bu Jianhao Ding Zecheng Hao Tiejun Huang Zhaofei Yu AAML 37 3 0 30 May 2024
High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost Jiakui Hu Man Yao Xuerui Qiu Yuhong Chou Yuxuan Cai Ning Qiao Yonghong Tian Boxing Xu Guoqi Li AI4CE 35 9 0 26 May 2024
Advancing Spiking Neural Networks towards Multiscale Spatiotemporal Interaction Learning Yimeng Shan Malu Zhang Rui-jie Zhu Xuerui Qiu Jason Eshraghian Haicheng Qu 45 6 0 22 May 2024
Learning A Spiking Neural Network for Efficient Image Deraining Tianyu Song Guiyue Jin Pengpeng Li Kui Jiang Xiang Chen Jiyu Jin 49 9 0 10 May 2024
Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methods Chenlin Zhou Han Zhang Liutao Yu Yumin Ye Zhaokun Zhou Liwei Huang Zhengyu Ma Xiaopeng Fan Huihui Zhou Yonghong Tian 46 10 0 06 May 2024
Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs Zhipeng Huang Jianhao Ding Zhiyu Pan Haoran Li Ying Fang Zhaofei Yu Jian K. Liu 34 0 0 26 Apr 2024
Towards free-response paradigm: a theory on decision-making in spiking neural networks Zhichao Zhu Yang Qi Wenlian Lu Zhigang Wang Lu Cao Jianfeng Feng 27 1 0 16 Apr 2024
Direct Training Needs Regularisation: Anytime Optimal Inference Spiking Neural Network Dengyu Wu Yi Qi Kaiwen Cai Gao Jin Xinping Yi Xiaowei Huang 37 3 0 15 Apr 2024
FTBC: Forward Temporal Bias Correction for Optimizing ANN-SNN Conversion Xiaofeng Wu V. Bojkovic Bin Gu Kun Suo Kai Zou 25 3 0 27 Mar 2024
Fourier or Wavelet bases as counterpart self-attention in spikformer for efficient visual classification Qingyu Wang Duzhen Zhang Tilelin Zhang Bo Xu 39 1 0 27 Mar 2024
QKFormer: Hierarchical Spiking Transformer using Q-K Attention Chenlin Zhou Han Zhang Zhaokun Zhou Liutao Yu Liwei Huang Xiaopeng Fan Liuliang Yuan Zhengyu Ma Huihui Zhou Yonghong Tian 55 15 0 25 Mar 2024
Spiking Wavelet Transformer Yuetong Fang Ziqing Wang Lingfeng Zhang Jiahang Cao Honglei Chen Renjing Xu 64 5 0 17 Mar 2024
EventRPG: Event Data Augmentation with Relevance Propagation Guidance Mingyuan Sun Donghao Zhang Zongyuan Ge Jiaxu Wang Jia Li Zheng Fang Renjing Xu 32 7 0 14 Mar 2024
Efficient Online Learning for Networks of Two-Compartment Spiking Neurons Yujia Yin Xinyi Chen Chenxiang Ma Jibin Wu Kay Chen Tan 37 0 0 25 Feb 2024
Parallel Spiking Unit for Efficient Training of Spiking Neural Networks Yang Li Yinqian Sun Xiang-Yu He Yiting Dong Dongcheng Zhao Yi Zeng 34 3 0 01 Feb 2024
LM-HT SNN: Enhancing the Performance of SNN to ANN Counterpart through Learnable Multi-hierarchical Threshold Model Zecheng Hao Xinyu Shi Zhiyu Pan Yujia Liu Zhaofei Yu Tiejun Huang 29 4 0 01 Feb 2024
TT-SNN: Tensor Train Decomposition for Efficient Spiking Neural Network Training Donghyun Lee Ruokai Yin Youngeun Kim Abhishek Moitra Yuhang Li Priyadarshini Panda 21 3 0 15 Jan 2024
Take A Shortcut Back: Mitigating the Gradient Vanishing for Training Spiking Neural Networks Yu-Zhu Guo Y. Chen 26 2 0 09 Jan 2024
Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket Zhaokun Zhou Kaiwei Che Wei Fang Keyu Tian Yuesheng Zhu Shuicheng Yan Yonghong Tian Liuliang Yuan ViT 41 28 0 04 Jan 2024
Shrinking Your TimeStep: Towards Low-Latency Neuromorphic Object Recognition with Spiking Neural Network Yongqi Ding Lin Zuo Mengmeng Jing Pei He Yongjun Xiao 34 16 0 02 Jan 2024
Deep Pulse-Coupled Neural Networks Zexiang Yi Jing Lian Yunliang Qi Zhaofei Yu Huajin Tang Yide Ma Jizhao Liu 23 2 0 24 Dec 2023
Memory-Efficient Reversible Spiking Neural Networks Hong Zhang Yu Zhang 26 8 0 13 Dec 2023
When Bio-Inspired Computing meets Deep Learning: Low-Latency, Accurate, & Energy-Efficient Spiking Neural Networks from Artificial Neural Networks Gourav Datta Zeyu Liu James Diffenderfer B. Kailkhura P. Beerel 43 0 0 12 Dec 2023
Ternary Spike: Learning Ternary Spikes for Spiking Neural Networks Yu-Zhu Guo Y. Chen Xiaode Liu Weihang Peng Yuhan Zhang Xuhui Huang Zhe Ma 33 28 0 11 Dec 2023
Spiking Neural Networks with Dynamic Time Steps for Vision Transformers Gourav Datta Zeyu Liu Anni Li P. Beerel 28 1 0 28 Nov 2023
Pursing the Sparse Limitation of Spiking Deep Learning Structures Hao-Ran Cheng Jiahang Cao Erjia Xiao Mengshu Sun Le Yang Jize Zhang Xue Lin B. Kailkhura Kaidi Xu Renjing Xu 16 1 0 18 Nov 2023
DISTA: Denoising Spiking Transformer with intrinsic plasticity and spatiotemporal attention Boxun Xu Hejia Geng Yuxuan Yin Peng Li 23 2 0 15 Nov 2023
SparseSpikformer: A Co-Design Framework for Token and Weight Pruning in Spiking Transformer Yue Liu Shanlin Xiao Bo Li Zhiyi Yu 35 3 0 15 Nov 2023
Adversarially Robust Spiking Neural Networks Through Conversion Ozan Özdenizci Robert Legenstein AAML 38 8 0 15 Nov 2023
Tensor Decomposition Based Attention Module for Spiking Neural Networks Haoyu Deng Rui-jie Zhu Xuerui Qiu Yule Duan Malu Zhang Liang-Jian Deng 27 13 0 23 Oct 2023
Spike-based Neuromorphic Computing for Next-Generation Computer Vision Md. Sakib Hasan Catherine D. Schuman Zhongyang Zhang Tauhidur Rahman Garrett S. Rose 36 0 0 15 Oct 2023
SpikeCLIP: A Contrastive Language-Image Pretrained Spiking Neural Network Tianlong Li Wenhao Liu Changze Lv Jianhan Xu Cenyuan Zhang Muling Wu Xiaoqing Zheng Xuanjing Huang CLIP VLM 23 2 0 10 Oct 2023
Gaining the Sparse Rewards by Exploring Lottery Tickets in Spiking Neural Network Hao Cheng Jiahang Cao Erjia Xiao Mengshu Sun Renjing Xu 20 2 0 23 Sep 2023
SpikingNeRF: Making Bio-inspired Neural Networks See through the Real World Xing-Hua Yao Qinghao Hu Tielong Liu Zitao Mo Zeyu Zhu Zhengyang Zhuge Jia Cheng 25 3 0 20 Sep 2023
Chasing Day and Night: Towards Robust and Efficient All-Day Object Detection Guided by an Event Camera Jiahang Cao Xueye Zheng Y. Lyu Jiaxu Wang Renjing Xu Lin Wang 29 14 0 17 Sep 2023
V2CE: Video to Continuous Events Simulator Zhongyang Zhang Shuyang Cui Kaidong Chai Haowen Yu S. Dasgupta U. Mahbub Tauhidur Rahman 32 6 0 16 Sep 2023
Brain-inspired Evolutionary Architectures for Spiking Neural Networks Wenxuan Pan Feifei Zhao Zhuoya Zhao Yi Zeng 47 3 0 11 Sep 2023
Membrane Potential Batch Normalization for Spiking Neural Networks Yu-Zhu Guo Yuhan Zhang Y. Chen Weihang Peng Xiaode Liu Liwen Zhang Xuhui Huang Zhe Ma AAML 32 37 0 16 Aug 2023
RMP-Loss: Regularizing Membrane Potential Distribution for Spiking Neural Networks Yu-Zhu Guo Xiaode Liu Y. Chen Liwen Zhang Weihang Peng Yuhan Zhang Xuhui Huang Zhe Ma AAML MQ 49 23 0 13 Aug 2023
Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks Xuerui Qiu Rui-Jie Zhu Yuhong Chou Zhaorui Wang Liang-Jian Deng Guoqi Li 28 29 0 12 Aug 2023
Resource Constrained Model Compression via Minimax Optimization for Spiking Neural Networks Jue Chen Huan Yuan Jianchao Tan Bin Chen Chengru Song Di Zhang 25 3 0 09 Aug 2023
Attention-free Spikformer: Mixing Spike Sequences with Simple Linear Transforms Qingyu Wang Duzhen Zhang Tielin Zhang Bo Xu 33 3 0 02 Aug 2023
Gradient Scaling on Deep Spiking Neural Networks with Spike-Dependent Local Information Seong Gon Park Jeonghee Jo Jongkil Park Yeonjoo Jeong Jaewook Kim ... Inho Kim Jong-Keuk Park Kyeong-Seok Lee Gyeongyeon Hwang Hyun Jae Jang 8 0 0 01 Aug 2023
Automotive Object Detection via Learning Sparse Events by Spiking Neurons Hu Zhang Yanchen Li Luziwei Leng Kaiwei Che Qian Liu Qinghai Guo Jianxing Liao Ran Cheng 34 6 0 24 Jul 2023
InfLoR-SNN: Reducing Information Loss for Spiking Neural Networks Yu-Zhu Guo Y. Chen Liwen Zhang Xiaode Liu Xinyi Tong Yuanyuan Ou Xuhui Huang Zhe Ma AAML 41 3 0 10 Jul 2023
Spike-driven Transformer Man Yao Jiakui Hu Zhaokun Zhou Liuliang Yuan Yonghong Tian Boxing Xu Guoqi Li 34 114 0 04 Jul 2023
AutoST: Training-free Neural Architecture Search for Spiking Transformers Ziqing Wang Qidong Zhao Jinku Cui Xu Liu Dongkuan Xu 21 5 0 01 Jul 2023
Spiking Denoising Diffusion Probabilistic Models Jiahang Cao Ziqing Wang Hanzhong Guo Haotai Cheng Qiang Zhang Renjing Xu DiffM 22 19 0 29 Jun 2023
S-TLLR: STDP-inspired Temporal Local Learning Rule for Spiking Neural Networks M. Apolinario Kaushik Roy 52 2 0 27 Jun 2023
Efficient Deep Spiking Multi-Layer Perceptrons with Multiplication-Free Inference Boyan Li Luziwei Leng Shuaijie Shen Kaixuan Zhang Jianguo Zhang Jianxing Liao Ran Cheng 31 7 0 21 Jun 2023