QKFormer: Hierarchical Spiking Transformer using Q-K Attention

QKFormer: Hierarchical Spiking Transformer using Q-K Attention

25 March 2024

Yonghong Tian

Papers citing "QKFormer: Hierarchical Spiking Transformer using Q-K Attention"

6 / 6 papers shown

Title
SpiLiFormer: Enhancing Spiking Transformers with Lateral Inhibition Zeqi Zheng Yanchen Huang Yingchao Yu Zizheng Zhu Junfeng Tang Zhaofei Yu Yaochu Jin 39 0 0 20 Mar 2025
Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networks Tong Bu Wei Fang Jianhao Ding Penglin Dai Zhaofei Yu Tiejun Huang 105 195 0 08 Mar 2023
Spikformer: When Spiking Neural Network Meets Transformer Zhaokun Zhou Yuesheng Zhu Chao He Yaowei Wang Shuicheng Yan Yonghong Tian Liuliang Yuan 145 241 0 29 Sep 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 305 7,443 0 11 Nov 2021
Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium State Mingqing Xiao Qingyan Meng Zongpeng Zhang Yisen Wang Zhouchen Lin 111 60 0 29 Sep 2021
Deep Residual Learning in Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen Tiejun Huang T. Masquelier Yonghong Tian 123 477 0 08 Feb 2021