Towards High-performance Spiking Transformers from ANN to SNN Conversion

28 February 2025

Papers citing "Towards High-performance Spiking Transformers from ANN to SNN Conversion"

29 / 29 papers shown

Title
Differential Coding for Training-Free ANN-to-SNN Conversion Zihan Huang Wei Fang Tong Bu Peng Xue Zecheng Hao Xiaohan Yu Yuanhong Tang Zhaofei Yu Tiejun Huang 79 1 0 01 Mar 2025
Spike-driven Transformer Man Yao Jiakui Hu Zhaokun Zhou Liuliang Yuan Yonghong Tian Boxing Xu Guoqi Li 70 129 0 04 Jul 2023
EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention Xinyu Liu Houwen Peng Ningxin Zheng Yuqing Yang Han Hu Yixuan Yuan ViT 48 299 0 11 May 2023
EVA-CLIP: Improved Training Techniques for CLIP at Scale Quan-Sen Sun Yuxin Fang Ledell Yu Wu Xinlong Wang Yue Cao CLIP VLM 129 493 0 27 Mar 2023
EVA-02: A Visual Representation for Neon Genesis Yuxin Fang Quan-Sen Sun Xinggang Wang Tiejun Huang Xinlong Wang Yue Cao VLM ViT CLIP 83 283 0 20 Mar 2023
Reducing ANN-SNN Conversion Error through Residual Membrane Potential Zecheng Hao Tong Bu Jianhao Ding Tiejun Huang Zhaofei Yu 83 60 0 04 Feb 2023
Complex Dynamic Neurons Improved Spiking Transformer Network for Efficient Automatic Speech Recognition Minglun Han Qingyu Wang Tielin Zhang Yi Wang Duzhen Zhang Bo Xu 48 29 0 02 Feb 2023
EVA: Exploring the Limits of Masked Visual Representation Learning at Scale Yuxin Fang Wen Wang Binhui Xie Quan-Sen Sun Ledell Yu Wu Xinggang Wang Tiejun Huang Xinlong Wang Yue Cao VLM CLIP 168 710 0 14 Nov 2022
OneFormer: One Transformer to Rule Universal Image Segmentation Jitesh Jain Jiacheng Li M. Chiu Ali Hassani Nikita Orlov Humphrey Shi ViT 47 343 0 10 Nov 2022
Spikformer: When Spiking Neural Network Meets Transformer Zhaokun Zhou Yuesheng Zhu Chao He Yaowei Wang Shuicheng Yan Yonghong Tian Liuliang Yuan 174 260 0 29 Sep 2022
Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikes Yang Li Yi Zeng 57 58 0 28 Apr 2022
Optimized Potential Initialization for Low-latency Spiking Neural Networks Tong Bu Jianhao Ding Zhaofei Yu Tiejun Huang 134 90 0 03 Feb 2022
A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration Yuhang Li Shi-Wee Deng Xin Dong Ruihao Gong Shi Gu 58 191 0 13 Jun 2021
Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks Jianhao Ding Zhaofei Yu Yonghong Tian Tiejun Huang 75 157 0 25 May 2021
Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networks Shi-Wee Deng Shi Gu 151 204 0 28 Feb 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 830 29,341 0 26 Feb 2021
Deep Residual Learning in Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen Tiejun Huang T. Masquelier Yonghong Tian 157 496 0 08 Feb 2021
TCL: an ANN-to-SNN Conversion with Trainable Clipping Layers Nguyen-Dong Ho I. Chang 47 50 0 11 Aug 2020
Brain-inspired global-local learning incorporated with neuromorphic computing Yujie Wu R. Zhao Jun Zhu F. Chen Mingkun Xu ... Hao Zheng Jing Pei Youhui Zhang Mingguo Zhao Luping Shi 63 89 0 05 Jun 2020
RMP-SNN: Residual Membrane Potential Neuron for Enabling Deeper High-Accuracy and Low-Latency Spiking Neural Network Bing Han G. Srinivasan Kaushik Roy 59 315 0 25 Feb 2020
Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural Networks Wenrui Zhang Peng Li 71 220 0 24 Feb 2020
Surrogate Gradient Learning in Spiking Neural Networks Emre Neftci Hesham Mostafa Friedemann Zenke 87 1,236 0 28 Jan 2019
Direct Training for Spiking Neural Networks: Faster, Larger, Better Yujie Wu Lei Deng Guoqi Li Jun Zhu Luping Shi 73 656 0 16 Sep 2018
Deep Learning in Spiking Neural Networks A. Tavanaei M. Ghodrati Saeed Reza Kheradpisheh T. Masquelier Anthony Maida 55 1,072 0 22 Apr 2018
Going Deeper in Spiking Neural Networks: VGG and Residual Architectures Abhronil Sengupta Yuting Ye Robert Y. Wang Chiao Liu Kaushik Roy 76 1,000 0 07 Feb 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 660 131,414 0 12 Jun 2017
Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networks Yujie Wu Lei Deng Guoqi Li Jun Zhu Luping Shi 62 1,019 0 08 Jun 2017
Training Deep Spiking Neural Networks using Backpropagation Junhaeng Lee T. Delbruck Michael Pfeiffer 87 945 0 31 Aug 2016
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.6K 39,509 0 01 Sep 2014