v1v2v3 (latest)

Delving Deeper Into Astromorphic Transformers

18 December 2023

Papers citing "Delving Deeper Into Astromorphic Transformers"

28 / 28 papers shown

Title
Spikingformer: Spike-driven Residual Learning for Transformer-based Spiking Neural Network Chenlin Zhou Liutao Yu Zhaokun Zhou Zhengyu Ma Han Zhang Huihui Zhou Yonghong Tian 77 67 0 24 Apr 2023
Spikformer: When Spiking Neural Network Meets Transformer Zhaokun Zhou Yuesheng Zhu Chao He Yaowei Wang Shuicheng Yan Yonghong Tian Liuliang Yuan 208 260 0 29 Sep 2022
Astromorphic Self-Repair of Neuromorphic Hardware Systems Zhuang Han Nafiul Islam Abhronil Sengupta 53 5 0 15 Sep 2022
Text Classification in Memristor-based Spiking Neural Networks Jinqi Huang A. Serb S. Stathopoulos T. Prodromakis 38 14 0 27 Jul 2022
BioLeaF: A Bio-plausible Learning Framework for Training of Spiking Neural Networks Yukun Yang Peng Li 60 3 0 14 Nov 2021
CoAtNet: Marrying Convolution and Attention for All Data Sizes Zihang Dai Hanxiao Liu Quoc V. Le Mingxing Tan ViT 126 1,208 0 09 Jun 2021
UnICORNN: A recurrent model for learning very long time dependencies T. Konstantin Rusch Siddhartha Mishra 76 62 0 09 Mar 2021
Linear Transformers Are Secretly Fast Weight Programmers Imanol Schlag Kazuki Irie Jürgen Schmidhuber 124 252 0 22 Feb 2021
Learning Associative Inference Using Fast Weight Memory Imanol Schlag Tsendsuren Munkhdalai Jürgen Schmidhuber KELM 56 47 0 16 Nov 2020
Coupled Oscillatory Recurrent Neural Network (coRNN): An accurate and (gradient) stable architecture for learning long time dependencies T. Konstantin Rusch Siddhartha Mishra 117 93 0 02 Oct 2020
On the Self-Repair Role of Astrocytes in STDP Enabled Unsupervised SNNs Mehul Rastogi Sen Lu Nafiul Islam Abhronil Sengupta 51 22 0 08 Sep 2020
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas Franccois Fleuret 201 1,786 0 29 Jun 2020
An Astrocyte-Modulated Neuromorphic Central Pattern Generator for Hexapod Robot Locomotion on Intel's Loihi Ioannis E. Polykretis Konstantinos Michmizos 58 28 0 08 Jun 2020
Stand-Alone Self-Attention in Vision Models Prajit Ramachandran Niki Parmar Ashish Vaswani Irwan Bello Anselm Levskaya Jonathon Shlens VLM SLR ViT 101 1,216 0 13 Jun 2019
Deep Residual Output Layers for Neural Language Generation Nikolaos Pappas James Henderson 68 7 0 14 May 2019
Language Models with Transformers Chenguang Wang Mu Li Alex Smola 72 121 0 20 Apr 2019
An Attentive Survey of Attention Models S. Chaudhari Varun Mithal Gungor Polatkan R. Ramanath 144 662 0 05 Apr 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Direct Output Connection for a High-Rank Language Model Sho Takase Jun Suzuki Masaaki Nagata 73 36 0 30 Aug 2018
Deep Learning in Spiking Neural Networks A. Tavanaei M. Ghodrati Saeed Reza Kheradpisheh T. Masquelier Anthony Maida 80 1,078 0 22 Apr 2018
Self-Attention with Relative Position Representations Peter Shaw Jakob Uszkoreit Ashish Vaswani 179 2,296 0 06 Mar 2018
Going Deeper in Spiking Neural Networks: VGG and Residual Architectures Abhronil Sengupta Yuting Ye Robert Y. Wang Chiao Liu Kaushik Roy 78 1,006 0 07 Feb 2018
Breaking the Softmax Bottleneck: A High-Rank RNN Language Model Zhilin Yang Zihang Dai Ruslan Salakhutdinov William W. Cohen BDL 71 372 0 10 Nov 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 786 132,363 0 12 Jun 2017
SuperSpike: Supervised learning in multi-layer spiking neural networks Friedemann Zenke Surya Ganguli 83 566 0 31 May 2017
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 338 2,898 0 26 Sep 2016
Supervised learning based on temporal coding in spiking neural networks Hesham Mostafa 79 355 0 27 Jun 2016
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 305 5,534 0 23 Nov 2015