Dense for the Price of Sparse: Improved Performance of Sparsely Initialized Networks via a Subspace Offset

12 February 2021

Papers citing "Dense for the Price of Sparse: Improved Performance of Sparsely Initialized Networks via a Subspace Offset"

12 / 12 papers shown

Title
Pushing the Limits of Sparsity: A Bag of Tricks for Extreme Pruning Andy Li A. Durrant Milan Markovic Lu Yin Georgios Leontidis Tianlong Chen Lu Yin Georgios Leontidis 121 0 0 20 Nov 2024
Navigating Extremes: Dynamic Sparsity in Large Output Spaces Nasib Ullah Erik Schultheis Mike Lasby Yani Andrew Ioannou Rohit Babbar 63 1 0 05 Nov 2024
Progressive Skeletonization: Trimming more fat from a network at initialization Pau de Jorge Amartya Sanyal Harkirat Singh Behl Philip Torr Grégory Rogez P. Dokania 57 95 0 16 Jun 2020
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 260 1,049 0 06 Mar 2020
Proving the Lottery Ticket Hypothesis: Pruning is All You Need Eran Malach Gilad Yehudai Shai Shalev-Shwartz Ohad Shamir 99 275 0 03 Feb 2020
Rigging the Lottery: Making All Tickets Winners Utku Evci Trevor Gale Jacob Menick Pablo Samuel Castro Erich Elsen 184 602 0 25 Nov 2019
The State of Sparsity in Deep Neural Networks Trevor Gale Erich Elsen Sara Hooker 153 758 0 25 Feb 2019
SNIP: Single-shot Network Pruning based on Connection Sensitivity Namhoon Lee Thalaiyasingam Ajanthan Philip Torr VLM 252 1,199 0 04 Oct 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 225 3,463 0 09 Mar 2018
Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Science Decebal Constantin Mocanu Elena Mocanu Peter Stone Phuong H. Nguyen M. Gibescu A. Liotta 170 629 0 15 Jul 2017
Caffe con Troll: Shallow Ideas to Speed Up Deep Learning Stefan Hadjis Firas Abuzaid Ce Zhang Christopher Ré BDL 48 71 0 16 Apr 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 323 18,613 0 06 Feb 2015