Efficient recurrent architectures through activity sparsity and sparse
back-propagation through time

Efficient recurrent architectures through activity sparsity and sparse back-propagation through time

13 June 2022

Anand Subramoney

Khaleelulla Khan Nazeer

Papers citing "Efficient recurrent architectures through activity sparsity and sparse back-propagation through time"

19 / 19 papers shown

Title
Pushing the boundaries of event subsampling in event-based video classification using CNNs Hesam Araghi Jan van Gemert Nergis Tomen 43 0 0 13 Sep 2024
TRIP: Trainable Region-of-Interest Prediction for Hardware-Efficient Neuromorphic Processing on Event-based Vision Cina Arjmand Yingfu Xu K. Shidqi Alexandra Dobrita K. Vadivel Paul Detterer Manolis Sifalakis Amirreza Yousefzadeh Guangzhi Tang 27 0 0 25 Jun 2024
Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models Rishav Mukherji Mark Schöne Khaleelulla Khan Nazeer Christian Mayr David Kappel Anand Subramoney 37 2 0 01 May 2024
Scalable Event-by-event Processing of Neuromorphic Sensory Signals With Deep State-Space Models Mark Schöne Neeraj Mohan Sushma Jingyue Zhuge Christian Mayr Anand Subramoney David Kappel AI4TS BDL 48 9 0 29 Apr 2024
Quantized Context Based LIF Neurons for Recurrent Spiking Neural Networks in 45nm S.S. Bezugam Yihao Wu JaeBum Yoo D. Strukov Bongjin Kim 48 0 0 28 Apr 2024
Spiking Music: Audio Compression with Event Based Auto-encoders Martim Lisboa Guillaume Bellec 40 2 0 02 Feb 2024
SpiNNaker2: A Large-Scale Neuromorphic System for Event-Based and Asynchronous Machine Learning Hector A. Gonzalez Jiaxin Huang Florian Kelber Khaleelulla Khan Nazeer Tim Langer ... Bernhard Vogginger Timo C. Wunderlich Yexin Yan Mahmoud Akl Christian Mayr 24 16 0 09 Jan 2024
Exploiting Symmetric Temporally Sparse BPTT for Efficient RNN Training Xi Chen Chang Gao Zuowen Wang Longbiao Cheng Sheng Zhou Shih-Chii Liu T. Delbruck 31 2 0 14 Dec 2023
Language Modeling on a SpiNNaker 2 Neuromorphic Chip Khaleelulla Khan Nazeer Mark Schöne Rishav Mukherji Bernhard Vogginger Christian Mayr David Kappel Anand Subramoney 37 5 0 14 Dec 2023
Advancing State of the Art in Language Modeling David Herel Tomáš Mikolov 31 1 0 28 Nov 2023
Activity Sparsity Complements Weight Sparsity for Efficient RNN Inference Rishav Mukherji Mark Schöne Khaleelulla Khan Nazeer Christian Mayr Anand Subramoney 38 2 0 13 Nov 2023
Harnessing Manycore Processors with Distributed Memory for Accelerated Training of Sparse and Recurrent Models Jan Finkbeiner Thomas Gmeinder M. Pupilli A. Titterton Emre Neftci 21 3 0 07 Nov 2023
Beyond Weights: Deep learning in Spiking Neural Networks with pure synaptic-delay training Edoardo W. Grappolini Anand Subramoney 15 4 0 09 Jun 2023
Spike-based computation using classical recurrent neural networks Florent De Geeter D. Ernst G. Drion 16 1 0 06 Jun 2023
Distributed SLIDE: Enabling Training Large Neural Networks on Low Bandwidth and Simple CPU-Clusters via Model Parallelism and Sparsity Minghao Yan Nicholas Meisburger Tharun Medini Anshumali Shrivastava 19 6 0 29 Jan 2022
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 255 4,796 0 24 Feb 2021
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks Torsten Hoefler Dan Alistarh Tal Ben-Nun Nikoli Dryden Alexandra Peste MQ 141 684 0 31 Jan 2021
Temporal Binary Representation for Event-Based Action Recognition Simone Undri Innocenti Federico Becattini F. Pernici A. Bimbo 52 67 0 18 Oct 2020
Long short-term memory and learning-to-learn in networks of spiking neurons G. Bellec Darjan Salaj Anand Subramoney Robert Legenstein Wolfgang Maass 121 481 0 26 Mar 2018