SpikeBERT: A Language Spikformer Learned from BERT with Knowledge
Distillation

SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation

29 August 2023

Xuanjing Huang

Papers citing "SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillation"

11 / 11 papers shown

Title
Decision SpikeFormer: Spike-Driven Transformer for Decision Making Wei Huang Qinying Gu Nanyang Ye OffRL 29 1 0 04 Apr 2025
Scalable MatMul-free Language Modeling Rui-Jie Zhu Yu Zhang Ethan Sifferman Tyler Sheaves Yiqiao Wang Dustin Richmond P. Zhou Jason Eshraghian 31 17 0 04 Jun 2024
Advancing Spiking Neural Networks for Sequential Modeling with Central Pattern Generators Changze Lv Dongqi Han Yansen Wang Xiaoqing Zheng Xuanjing Huang Dongsheng Li 32 0 0 23 May 2024
Efficient and Effective Time-Series Forecasting with Spiking Neural Networks Changze Lv Yansen Wang Dongqi Han Xiaoqing Zheng Xuanjing Huang Dongsheng Li AI4TS TPM 28 4 0 02 Feb 2024
SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks Rui-Jie Zhu Qihang Zhao Guoqi Li Jason Eshraghian BDL VLM 26 82 0 27 Feb 2023
Spikformer: When Spiking Neural Network Meets Transformer Zhaokun Zhou Yuesheng Zhu Chao He Yaowei Wang Shuicheng Yan Yonghong Tian Liuliang Yuan 145 241 0 29 Sep 2022
Beyond Classification: Directly Training Spiking Neural Networks for Semantic Segmentation Youngeun Kim Joshua Chough Priyadarshini Panda 40 79 0 14 Oct 2021
Distilling Knowledge via Knowledge Review Pengguang Chen Shu-Lin Liu Hengshuang Zhao Jiaya Jia 149 420 0 19 Apr 2021
Deep Residual Learning in Spiking Neural Networks Wei Fang Zhaofei Yu Yanqing Chen Tiejun Huang T. Masquelier Yonghong Tian 123 477 0 08 Feb 2021
Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation Nitin Rathi G. Srinivasan Priyadarshini Panda Kaushik Roy 124 293 0 04 May 2020
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 255 13,364 0 25 Aug 2014