DISTA: Denoising Spiking Transformer with intrinsic plasticity and spatiotemporal attention

15 November 2023

Peng Li

Papers citing "DISTA: Denoising Spiking Transformer with intrinsic plasticity and spatiotemporal attention"

20 / 20 papers shown

Title
Input-Aware Dynamic Timestep Spiking Neural Networks for Efficient In-Memory Computing Yuhang Li Abhishek Moitra Tamar Geller Priyadarshini Panda 60 21 0 27 May 2023
Spikingformer: Spike-driven Residual Learning for Transformer-based Spiking Neural Network Chenlin Zhou Liutao Yu Zhaokun Zhou Zhengyu Ma Han Zhang Huihui Zhou Yonghong Tian 89 67 0 24 Apr 2023
SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks Rui-Jie Zhu Qihang Zhao Guoqi Li Jason K. Eshraghian BDL VLM 97 87 0 27 Feb 2023
Spikformer: When Spiking Neural Network Meets Transformer Zhaokun Zhou Yuesheng Zhu Chao He Yaowei Wang Shuicheng Yan Yonghong Tian Liuliang Yuan 225 261 0 29 Sep 2022
Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting Shi-Wee Deng Yuhang Li Shanghang Zhang Shi Gu 221 257 0 24 Feb 2022
Backpropagated Neighborhood Aggregation for Accurate Training of Spiking Neural Networks Yukun Yang Wenrui Zhang Peng Li AAML 157 27 0 22 Jun 2021
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers Enze Xie Wenhai Wang Zhiding Yu Anima Anandkumar J. Álvarez Ping Luo ViT 332 5,095 0 31 May 2021
Going Deeper With Directly-Trained Larger Spiking Neural Networks Hanle Zheng Yujie Wu Lei Deng Yifan Hu Guoqi Li 76 528 0 29 Oct 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 684 41,563 0 22 Oct 2020
Revisiting Batch Normalization for Training Low-latency Deep Spiking Neural Networks from Scratch Youngeun Kim Priyadarshini Panda 102 175 0 05 Oct 2020
DIET-SNN: Direct Input Encoding With Leakage and Threshold Optimization in Deep Spiking Neural Networks Nitin Rathi Kaushik Roy 102 135 0 09 Aug 2020
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas Franccois Fleuret 209 1,793 0 29 Jun 2020
Unifying Activation- and Timing-based Learning Rules for Spiking Neural Networks Jinseok Kim Kyungsu Kim Jae-Joon Kim 71 53 0 04 Jun 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 456 13,130 0 26 May 2020
Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation Nitin Rathi G. Srinivasan Priyadarshini Panda Kaushik Roy 173 304 0 04 May 2020
Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural Networks Wenrui Zhang Peng Li 76 222 0 24 Feb 2020
SLAYER: Spike Layer Error Reassignment in Time S. Shrestha Garrick Orchard 70 752 0 05 Sep 2018
Hybrid Macro/Micro Level Backpropagation for Training Deep Spiking Neural Networks Yingyezhe Jin Wenrui Zhang Peng Li 75 176 0 21 May 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 811 132,725 0 12 Jun 2017
Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networks Yujie Wu Lei Deng Guoqi Li Jun Zhu Luping Shi 64 1,030 0 08 Jun 2017