Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting

24 February 2022

Shi-Wee Deng

Yuhang Li

Shanghang Zhang

Shi Gu

ArXiv PDF HTML

Papers citing "Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting"

50 / 152 papers shown

Title
ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural Networks Jiangrong Shen Qi Xu Jian K. Liu Yueming Wang Gang Pan Huajin Tang 22 41 0 06 Jun 2023
Auto-Spikformer: Spikformer Architecture Search Kaiwei Che Zhaokun Zhou Zhengyu Ma Wei Fang Yanqing Chen Shuaijie Shen Liuliang Yuan Yonghong Tian 26 4 0 01 Jun 2023
Fast-SNN: Fast Spiking Neural Network by Converting Quantized ANN Yang‐Zhi Hu Qian Zheng Xudong Jiang Gang Pan MQ 26 48 0 31 May 2023
Direct Learning-Based Deep Spiking Neural Networks: A Review Yu-Zhu Guo Xuhui Huang Zhe Ma AI4CE 77 47 0 31 May 2023
A Hybrid Neural Coding Approach for Pattern Recognition with Spiking Neural Networks Xinyi Chen Qu Yang Jibin Wu Haizhou Li Kay Chen Tan 19 16 0 26 May 2023
Exploiting Noise as a Resource for Computation and Learning in Spiking Neural Networks Gehua (Marcus) Ma Rui Yan Huajin Tang 34 21 0 25 May 2023
Improving Stability and Performance of Spiking Neural Networks through Enhancing Temporal Consistency Dongcheng Zhao Guobin Shen Yiting Dong Yang Li Yi Zeng 40 7 0 23 May 2023
Temporal Contrastive Learning for Spiking Neural Networks Haonan Qiu Zeyin Song Yanqing Chen Munan Ning Wei Fang Tao Sun Zhengyu Ma Liuliang Yuan Yonghong Tian 11 1 0 23 May 2023
Enhancing the Performance of Transformer-based Spiking Neural Networks by SNN-optimized Downsampling with Precise Gradient Backpropagation Chenlin Zhou Han Zhang Zhaokun Zhou Liutao Yu Zhengyu Ma Huihui Zhou Xiaopeng Fan Yonghong Tian 26 9 0 10 May 2023
Joint A-SNN: Joint Training of Artificial and Spiking Neural Networks via Self-Distillation and Weight Factorization Yu-Zhu Guo Weihang Peng Y. Chen Liwen Zhang Xiaode Liu Xuhui Huang Zhe Ma 105 35 0 03 May 2023
Membrane Potential Distribution Adjustment and Parametric Surrogate Gradient in Spiking Neural Networks Siqi Wang Tee Hiang Cheng M. Lim 18 0 0 26 Apr 2023
Uncovering the Representation of Spiking Neural Networks Trained with Surrogate Gradient Yuhang Li Youngeun Kim Hyoungseob Park Priyadarshini Panda 32 16 0 25 Apr 2023
Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies Wei Fang Zhaofei Yu Zhaokun Zhou Ding Chen Yanqing Chen Zhengyu Ma T. Masquelier Yonghong Tian 29 39 0 25 Apr 2023
Spikingformer: Spike-driven Residual Learning for Transformer-based Spiking Neural Network Chenlin Zhou Liutao Yu Zhaokun Zhou Zhengyu Ma Han Zhang Huihui Zhou Yonghong Tian 30 61 0 24 Apr 2023
Accurate and Efficient Event-based Semantic Segmentation Using Adaptive Spiking Encoder-Decoder Network Rui Zhang Luziwei Leng Kaiwei Che Hu Zhang Jieling Cheng Qinghai Guo Jiangxing Liao Ran Cheng 31 11 0 24 Apr 2023
Biologically inspired structure learning with reverse knowledge distillation for spiking neural networks Qi Xu Yaxin Li Xuanye Fang Jiangrong Shen Jian K. Liu Huajin Tang Gang Pan 19 15 0 19 Apr 2023
Temporal Knowledge Sharing enable Spiking Neural Network Learning from Past and Future Yiting Dong Dongcheng Zhao Yi Zeng 29 9 0 13 Apr 2023
SEENN: Towards Temporal Spiking Early-Exit Neural Networks Yuhang Li Tamar Geller Youngeun Kim Priyadarshini Panda 24 37 0 02 Apr 2023
An Efficient Knowledge Transfer Strategy for Spiking Neural Networks from Static to Event Domain Xiang-Yu He Dongcheng Zhao Yang Li Guobin Shen Qingqun Kong Yi Zeng 42 5 0 23 Mar 2023
RN-Net: Reservoir Nodes-Enabled Neuromorphic Vision Sensing Network Sangmin Yoo Eric Lee Ziyu Wang Xinxin Wang Wei D. Lu 30 6 0 19 Mar 2023
Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks Qingyan Meng Mingqing Xiao Shen Yan Yisen Wang Zhouchen Lin Zhimin Luo 21 37 0 28 Feb 2023
Bridging the Gap between ANNs and SNNs by Calibrating Offset Spikes Zecheng Hao Jianhao Ding Tong Bu Tiejun Huang Zhaofei Yu 43 40 0 21 Feb 2023
Reducing ANN-SNN Conversion Error through Residual Membrane Potential Zecheng Hao Tong Bu Jianhao Ding Tiejun Huang Zhaofei Yu 25 54 0 04 Feb 2023
SPIDE: A Purely Spike-based Method for Training Feedback Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang Yisen Wang Zhouchen Lin 19 11 0 01 Feb 2023
Exploiting High Performance Spiking Neural Networks with Efficient Spiking Patterns Guobin Shen Dongcheng Zhao Yi Zeng 23 11 0 29 Jan 2023
Training Full Spike Neural Networks via Auxiliary Accumulation Pathway Guangyao Chen Peixi Peng Guoqi Li Yonghong Tian 29 23 0 27 Jan 2023
Optimising Event-Driven Spiking Neural Network with Regularisation and Cutoff Dengyu Wu Gao Jin Han Yu Xinping Yi Xiaowei Huang 24 2 0 23 Jan 2023
Hoyer regularizer is all you need for ultra low-latency spiking neural networks Gourav Datta Zeyu Liu P. Beerel 27 9 0 20 Dec 2022
Exploring Temporal Information Dynamics in Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Anna Hambitzer Priyadarshini Panda 19 32 0 26 Nov 2022
MSS-DepthNet: Depth Prediction with Multi-Step Spiking Neural Network Xiaoshan Wu Weihua He Man Yao Ziyang Zhang Yaoyuan Wang Guoqiu Li 6 5 0 22 Nov 2022
Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks Yuhang Li Ruokai Yin Hyoungseob Park Youngeun Kim Priyadarshini Panda 23 14 0 14 Nov 2022
Low Latency Conversion of Artificial Neural Network Models to Rate-encoded Spiking Neural Networks Zhanglu Yan Jun Zhou Weng-Fai Wong 30 2 0 27 Oct 2022
GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networks Xing-Hua Yao Fanrong Li Zitao Mo Jianguo Cheng 18 82 0 25 Oct 2022
STSC-SNN: Spatio-Temporal Synaptic Connection with Temporal Convolution and Attention for Spiking Neural Networks Chengting Yu Zheming Gu Da Li Gaoang Wang Aili Wang Erping Li 44 36 0 11 Oct 2022
Training Spiking Neural Networks with Local Tandem Learning Qu Yang Jibin Wu Malu Zhang Yansong Chua Xinchao Wang Haizhou Li 55 35 0 10 Oct 2022
Online Training Through Time for Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 45 60 0 09 Oct 2022
Masked Spiking Transformer Ziqing Wang Yuetong Fang Jiahang Cao Qiang Zhang Zhongrui Wang Renjing Xu 25 39 0 03 Oct 2022
Spikformer: When Spiking Neural Network Meets Transformer Zhaokun Zhou Yuesheng Zhu Chao He Yaowei Wang Shuicheng Yan Yonghong Tian Liuliang Yuan 145 241 0 29 Sep 2022
Attention Spiking Neural Networks Man Yao Guangshe Zhao Hengyu Zhang Yifan Hu Lei Deng Yonghong Tian Bo Xu Guoqi Li 30 161 0 28 Sep 2022
Exploring Lottery Ticket Hypothesis in Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Ruokai Yin Priyadarshini Panda 24 46 0 04 Jul 2022
TCJA-SNN: Temporal-Channel Joint Attention for Spiking Neural Networks Rui-Jie Zhu Tian-Jing Zhang Qihang Zhao Haoyu Deng Yule Duan Liang-Jian Deng AI4TS 31 56 0 21 Jun 2022
SNN2ANN: A Fast and Memory-Efficient Training Framework for Spiking Neural Networks Jianxiong Tang Jianhuang Lai Xiaohua Xie Lingxiao Yang Weimin Zheng 8 13 0 19 Jun 2022
Converting Artificial Neural Networks to Spiking Neural Networks via Parameter Calibration Yuhang Li Shi-Wee Deng Xin Dong Shi Gu 59 23 0 06 May 2022
Neuromorphic Data Augmentation for Training Spiking Neural Networks Yuhang Li Youngeun Kim Hyoungseob Park Tamar Geller Priyadarshini Panda 31 75 0 11 Mar 2022
Rethinking Pretraining as a Bridge from ANNs to SNNs Yihan Lin Yifan Hu Shiji Ma Guo-Qi Li Dongjie Yu 31 12 0 02 Mar 2022
Neural Architecture Search for Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Priyadarshini Panda 26 88 0 23 Jan 2022
Advancing Spiking Neural Networks towards Deep Residual Learning Yifan Hu Lei Deng Yujie Wu Man Yao Guoqi Li 21 83 0 15 Dec 2021
Backpropagated Neighborhood Aggregation for Accurate Training of Spiking Neural Networks Yukun Yang Wenrui Zhang Peng Li AAML 111 25 0 22 Jun 2021
PrivateSNN: Privacy-Preserving Spiking Neural Networks Youngeun Kim Yeshwanth Venkatesha Priyadarshini Panda 23 22 0 07 Apr 2021
Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks Shi-Wee Deng Shi Gu 118 200 0 28 Feb 2021