Attention Spiking Neural Networks

28 September 2022

Lei Deng

Yonghong Tian

Bo Xu

Guoqi Li

ArXiv PDF HTML

Papers citing "Attention Spiking Neural Networks"

50 / 51 papers shown

Title
SVL: Spike-based Vision-language Pretraining for Efficient 3D Open-world Understanding Xuerui Qiu Peixi Wu Yaozhi Wen Shaowei Gu Yuqi Pan Xinhao Luo Bo Xu Guoqi Li VLM 212 0 0 23 May 2025
Towards Mobile Sensing with Event Cameras on High-agility Resource-constrained Devices: A Survey Haoyang Wang Ruishan Guo Pengtao Ma Ciyu Ruan Xinyu Luo Wenhua Ding Tianyang Zhong Jingao Xu Yunhao Liu Xinlei Chen 87 0 0 29 Mar 2025
ES-Parkour: Advanced Robot Parkour with Bio-inspired Event Camera and Spiking Neural Network Qiang Zhang Jiahang Cao Jingkai Sun Yecheng Shao Gang Han Wen Zhao Yijie Guo Renjing Xu 120 0 0 13 Mar 2025
Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks Kairong Yu Chengting Yu Tianqing Zhang Xiaochen Zhao Shu Yang Hongwei Wang Qiang Zhang Qi Xu 111 5 0 05 Mar 2025
STAA-SNN: Spatial-Temporal Attention Aggregator for Spiking Neural Networks Tianqing Zhang Kairong Yu Xian Zhong Hongwei Wang Qi Xu Qiang Zhang 111 1 0 04 Mar 2025
NiSNN-A: Non-iterative Spiking Neural Networks with Attention with Application to Motor Imagery EEG Classification Chuhan Zhang Wei Pan Cosimo Della Santina 73 1 0 28 Jan 2025
Spiking Neural Network as Adaptive Event Stream Slicer Jiahang Cao Mingyuan Sun Ziqing Wang Hao Cheng Qiang Zhang Shibo Zhou Renjing Xu 103 2 0 03 Oct 2024
SpikeCLIP: A Contrastive Language-Image Pretrained Spiking Neural Network Changze Lv Tianlong Li Changze Lv Yufei Gu Jianhan Xu Cenyuan Zhang Muling Wu Xiaoqing Zheng Xuanjing Huang CLIP VLM 98 3 0 10 Oct 2023
Sparse Compressed Spiking Neural Network Accelerator for Object Detection Hong-Han Lien Tian-Sheuan Chang 48 28 0 02 May 2022
Rethinking Pretraining as a Bridge from ANNs to SNNs Yihan Lin Yifan Hu Shiji Ma Guo-Qi Li Dongjie Yu 63 12 0 02 Mar 2022
Temporal Efficient Training of Spiking Neural Network via Gradient Re-weighting Shi-Wee Deng Yuhang Li Shanghang Zhang Shi Gu 198 256 0 24 Feb 2022
Optimized Potential Initialization for Low-latency Spiking Neural Networks Tong Bu Jianhao Ding Zhaofei Yu Tiejun Huang 141 90 0 03 Feb 2022
Direct Training via Backpropagation for Ultra-low Latency Spiking Neural Networks with Multi-threshold Changqin Xu Yi Liu Yintang Yang 56 12 0 25 Nov 2021
Attention Mechanisms in Computer Vision: A Survey Meng-Hao Guo Tianhan Xu Jiangjiang Liu Zheng-Ning Liu Peng-Tao Jiang Tai-Jiang Mu Song-Hai Zhang Ralph Robert Martin Ming-Ming Cheng Shimin Hu 110 1,693 0 15 Nov 2021
HIRE-SNN: Harnessing the Inherent Robustness of Energy-Efficient Deep Spiking Neural Networks by Training with Crafted Input Noise Souvik Kundu Massoud Pedram Peter A. Beerel AAML 73 75 0 06 Oct 2021
One Timestep is All You Need: Training Spiking Neural Networks with Ultra Low Latency Sayeed Shafayet Chowdhury Nitin Rathi Kaushik Roy 63 41 0 01 Oct 2021
Temporal-wise Attention Spiking Neural Networks for Event Streams Classification Man Yao Huanhuan Gao Guangshe Zhao Dingheng Wang Yihan Lin Zhao-Xu Yang Guoqi Li AI4TS 51 159 0 25 Jul 2021
A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration Yuhang Li Shi-Wee Deng Xin Dong Ruihao Gong Shi Gu 63 192 0 13 Jun 2021
ViViT: A Video Vision Transformer Anurag Arnab Mostafa Dehghani G. Heigold Chen Sun Mario Lucic Cordelia Schmid ViT 222 2,150 0 29 Mar 2021
Visual Explanations from Spiking Neural Networks using Interspike Intervals Youngeun Kim Priyadarshini Panda AAML FAtt 64 47 0 26 Mar 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 447 21,439 0 25 Mar 2021
Accurate and efficient time-domain classification with adaptive spiking recurrent neural networks Bojian Yin Federico Corradi S. Bohté 80 216 0 12 Mar 2021
Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks Shi-Wee Deng Shi Gu 162 204 0 28 Feb 2021
Is Space-Time Attention All You Need for Video Understanding? Gedas Bertasius Heng Wang Lorenzo Torresani ViT 369 2,053 0 09 Feb 2021
Deep Residual Learning in Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen Tiejun Huang T. Masquelier Yonghong Tian 157 496 0 08 Feb 2021
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet Li-xin Yuan Yunpeng Chen Tao Wang Weihao Yu Yujun Shi Zihang Jiang Francis E. H. Tay Jiashi Feng Shuicheng Yan ViT 133 1,939 0 28 Jan 2021
A Survey on Visual Transformer Kai Han Yunhe Wang Hanting Chen Xinghao Chen Jianyuan Guo ... Chunjing Xu Yixing Xu Zhaohui Yang Yiman Zhang Dacheng Tao ViT 200 2,230 0 23 Dec 2020
Going Deeper With Directly-Trained Larger Spiking Neural Networks Hanle Zheng Yujie Wu Lei Deng Yifan Hu Guoqi Li 69 523 0 29 Oct 2020
Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen T. Masquelier Tiejun Huang Yonghong Tian 139 527 0 11 Jul 2020
Progressive Tandem Learning for Pattern Recognition with Deep Spiking Neural Networks Jibin Wu Chenglin Xu Daquan Zhou Haizhou Li Kay Chen Tan 46 115 0 02 Jul 2020
RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural Network Bing Han G. Srinivasan Kaushik Roy 62 316 0 25 Feb 2020
A Comprehensive and Modularized Statistical Framework for Gradient Norm Equality in Deep Neural Networks Zhaodong Chen Lei Deng Bangyan Wang Guoqi Li Yuan Xie 105 29 0 01 Jan 2020
Comprehensive SNN Compression Using ADMM Optimization and Activity Regularization Lei Deng Yujie Wu Yifan Hu Ling Liang Guoqi Li Xing Hu Yufei Ding Peng Li Yuan Xie 70 85 0 03 Nov 2019
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks Qilong Wang Banggu Wu Peng Fei Zhu P. Li W. Zuo Q. Hu 140 4,020 0 08 Oct 2019
Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function: Learning with Backpropagation Iulia Comsa Krzysztof Potempa Luca Versari T. Fischbacher Andrea Gesmundo J. Alakuijala 70 178 0 30 Jul 2019
High Speed and High Dynamic Range Video with an Event Camera Henri Rebecq René Ranftl V. Koltun Davide Scaramuzza 68 585 0 15 Jun 2019
Event-based Vision: A Survey Guillermo Gallego T. Delbruck Garrick Orchard Chiara Bartolozzi B. Taba ... Stefan Leutenegger Andrew J. Davison Jorg Conradt Kostas Daniilidis Davide Scaramuzza 91 1,801 0 17 Apr 2019
Surrogate Gradient Learning in Spiking Neural Networks Emre Neftci Hesham Mostafa Friedemann Zenke 90 1,237 0 28 Jan 2019
Global Second-order Pooling Convolutional Networks Zilin Gao Jiangtao Xie Qilong Wang P. Li 63 335 0 29 Nov 2018
SLAYER: Spike Layer Error Reassignment in Time S. Shrestha Garrick Orchard 56 751 0 05 Sep 2018
CBAM: Convolutional Block Attention Module Sanghyun Woo Jongchan Park Joon-Young Lee In So Kweon 224 16,553 0 17 Jul 2018
Going Deeper in Spiking Neural Networks: VGG and Residual Architectures Abhronil Sengupta Yuting Ye Robert Y. Wang Chiao Liu Kaushik Roy 78 1,004 0 07 Feb 2018
Squeeze-and-Excitation Networks Jie Hu Li Shen Samuel Albanie Gang Sun Enhua Wu 424 26,500 0 05 Sep 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 701 131,652 0 12 Jun 2017
Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networks Yujie Wu Lei Deng Guoqi Li Jun Zhu Luping Shi 62 1,022 0 08 Jun 2017
Residual Attention Network for Image Classification Fei Wang Mengqing Jiang Chao Qian Shuo Yang Cheng Li Honggang Zhang Xiaogang Wang Xiaoou Tang 115 3,310 0 23 Apr 2017
Efficient Processing of Deep Neural Networks: A Tutorial and Survey Vivienne Sze Yu-hsin Chen Tien-Ju Yang J. Emer AAML 3DV 120 3,022 0 27 Mar 2017
Learning Deep Features for Discriminative Localization Bolei Zhou A. Khosla Àgata Lapedriza A. Oliva Antonio Torralba SSL SSeg FAtt 250 9,319 0 14 Dec 2015
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,305 0 11 Feb 2015