v1v2v3v4v5 (latest)

Deep Rewiring: Training very sparse deep networks

14 November 2017

Papers citing "Deep Rewiring: Training very sparse deep networks"

22 / 22 papers shown

Title
Sparse-to-Sparse Training of Diffusion Models Inês Cardoso Oliveira Decebal Constantin Mocanu Luis A. Leiva DiffM 144 0 0 30 Apr 2025
Brain network science modelling of sparse neural networks enables Transformers and LLMs to perform as fully connected Yingtao Zhang Diego Cerretti Jialin Zhao Wenjing Wu Ziheng Liao Umberto Michieli C. Cannistraci 99 1 0 31 Jan 2025
Asynchronous Stochastic Gradient Descent with Decoupled Backpropagation and Layer-Wise Updates Cabrel Teguemne Fokam Khaleelulla Khan Nazeer Lukas König David Kappel Anand Subramoney 69 0 0 08 Oct 2024
Dynamic Sparse Training versus Dense Training: The Unexpected Winner in Image Corruption Robustness Boqian Wu Q. Xiao Shunxin Wang N. Strisciuglio Mykola Pechenizkiy M. V. Keulen Decebal Constantin Mocanu Elena Mocanu OOD 3DH 194 3 0 03 Oct 2024
Always-Sparse Training by Growing Connections with Guided Stochastic Exploration Mike Heddes Narayan Srinivasa T. Givargis Alexandru Nicolau 249 0 0 12 Jan 2024
Learning Internal Representations (COLT 1995) Jonathan Baxter SSL AI4CE 123 400 0 13 Nov 2019
Spiking neural networks trained with backpropagation for low power neuromorphic implementation of voice activity detection Flavio Martinelli Giorgia Dellaferrera Pablo Mainar Milos Cernak 38 31 0 22 Oct 2019
Exploring Sparsity in Recurrent Neural Networks Sharan Narang Erich Elsen G. Diamos Shubho Sengupta 40 312 0 17 Apr 2017
In-Datacenter Performance Analysis of a Tensor Processing Unit N. Jouppi C. Young Nishant Patil David Patterson Gaurav Agrawal ... Vijay Vasudevan Richard Walter Walter Wang Eric Wilcox Doe Hyun Yoon 235 4,638 0 16 Apr 2017
A dynamic connectome supports the emergence of stable computational function of neural circuits through reward-based learning David Kappel Robert Legenstein Stefan Habenschuss M. Hsieh Wolfgang Maass 30 13 0 13 Apr 2017
ESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGA Song Han Junlong Kang Huizi Mao Yiming Hu Xin Li ... Hong Luo Song Yao Yu Wang Huazhong Yang W. Dally 75 629 0 01 Dec 2016
Training Skinny Deep Neural Networks with Iterative Hard Thresholding Methods Xiaojie Jin Xiao-Tong Yuan Jiashi Feng Shuicheng Yan 393 78 0 19 Jul 2016
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size F. Iandola Song Han Matthew W. Moskewicz Khalid Ashraf W. Dally Kurt Keutzer 153 7,495 0 24 Feb 2016
Bridging the Gap between Stochastic Gradient MCMC and Stochastic Optimization Changyou Chen David Carlson Zhe Gan Chunyuan Li Lawrence Carin 67 90 0 25 Dec 2015
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding Song Han Huizi Mao W. Dally 3DGS 263 8,854 0 01 Oct 2015
Data-free parameter pruning for Deep Neural Networks Suraj Srinivas R. Venkatesh Babu 3DPC 76 547 0 22 Jul 2015
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 313 6,694 0 08 Jun 2015
Network Plasticity as Bayesian Inference David Kappel Stefan Habenschuss Robert Legenstein Wolfgang Maass 72 122 0 20 Apr 2015
LSTM: A Search Space Odyssey Klaus Greff R. Srivastava Jan Koutník Bas R. Steunebrink Jürgen Schmidhuber AI4TS VLM 124 5,303 0 13 Mar 2015
Deep Fried Convnets Zichao Yang Marcin Moczulski Misha Denil Nando de Freitas Alex Smola Le Song Ziyu Wang 102 267 0 22 Dec 2014
Memory Bounded Deep Convolutional Networks Maxwell D. Collins Pushmeet Kohli 110 172 0 03 Dec 2014
Speech Recognition with Deep Recurrent Neural Networks Alex Graves Abdel-rahman Mohamed Geoffrey E. Hinton 228 8,523 0 22 Mar 2013