Scalable Training of Artificial Neural Networks with Adaptive Sparse
Connectivity inspired by Network Science

Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Science

15 July 2017

Decebal Constantin Mocanu

Phuong H. Nguyen

Papers citing "Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Science"

14 / 114 papers shown

Title
Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers Junjie Liu Zhe Xu Runbin Shi R. Cheung Hayden Kwok-Hay So 17 119 0 14 May 2020
Sparse Weight Activation Training Md Aamir Raihan Tor M. Aamodt 34 73 0 07 Jan 2020
A Survey of Machine Learning Applied to Computer Architecture Design Drew Penney Lizhong Chen AI4CE 29 28 0 26 Sep 2019
Exascale Deep Learning to Accelerate Cancer Research Robert M. Patton J. T. Johnston Steven R. Young Catherine D. Schuman T. Potok ... Junghoon Chae L. Hou Shahira Abousamra Dimitris Samaras Joel H. Saltz 21 15 0 26 Sep 2019
TabNet: Attentive Interpretable Tabular Learning Sercan Ö. Arik Tomas Pfister LMTD 55 1,293 0 20 Aug 2019
Sparse Networks from Scratch: Faster Training without Losing Performance Tim Dettmers Luke Zettlemoyer 20 334 0 10 Jul 2019
On improving deep learning generalization with adaptive sparse connectivity Shiwei Liu Decebal Constantin Mocanu Mykola Pechenizkiy ODL 20 7 0 27 Jun 2019
Cognitive Model Priors for Predicting Human Decisions David D. Bourgin Joshua C. Peterson Daniel Reichman Thomas Griffiths Stuart J. Russell 19 72 0 22 May 2019
A Brain-inspired Algorithm for Training Highly Sparse Neural Networks Zahra Atashgahi Joost Pieterse Shiwei Liu Decebal Constantin Mocanu Raymond N. J. Veldhuis Mykola Pechenizkiy 35 15 0 17 Mar 2019
The State of Sparsity in Deep Neural Networks Trevor Gale Erich Elsen Sara Hooker 33 747 0 25 Feb 2019
Parameter Efficient Training of Deep Convolutional Neural Networks by Dynamic Sparse Reparameterization Hesham Mostafa Xin Wang 37 307 0 15 Feb 2019
Intrinsically Sparse Long Short-Term Memory Networks Shiwei Liu Decebal Constantin Mocanu Mykola Pechenizkiy 30 9 0 26 Jan 2019
Pre-Defined Sparse Neural Networks with Hardware Acceleration Sourya Dey Kuan-Wen Huang Peter A. Beerel K. Chugg 43 24 0 04 Dec 2018
SNIP: Single-shot Network Pruning based on Connection Sensitivity Namhoon Lee Thalaiyasingam Ajanthan Philip Torr VLM 87 1,176 0 04 Oct 2018