Learning Sparse Neural Networks through $L_0$ Regularization

4 December 2017

Papers citing "Learning Sparse Neural Networks through $L_0$ Regularization"

50 / 221 papers shown

Title
Rethinking Weight Decay For Efficient Neural Network Pruning Hugo Tessier Vincent Gripon Mathieu Léonardon M. Arzel T. Hannagan David Bertrand 31 25 0 20 Nov 2020
Layer-Wise Data-Free CNN Compression Maxwell Horton Yanzi Jin Ali Farhadi Mohammad Rastegari MQ 24 17 0 18 Nov 2020
Dynamic Hard Pruning of Neural Networks at the Edge of the Internet Lorenzo Valerio F. M. Nardini A. Passarella R. Perego 25 12 0 17 Nov 2020
LOss-Based SensiTivity rEgulaRization: towards deep sparse neural networks Enzo Tartaglione Andrea Bragagnolo Attilio Fiandrotti Marco Grangetto ODL UQCV 22 34 0 16 Nov 2020
Learning to Drop: Robust Graph Neural Network via Topological Denoising Dongsheng Luo Wei Cheng Wenchao Yu Bo Zong Jingchao Ni Haifeng Chen Xiang Zhang OOD 21 259 0 13 Nov 2020
Dirichlet Pruning for Neural Network Compression Kamil Adamczewski Mijung Park 27 3 0 10 Nov 2020
Know What You Don't Need: Single-Shot Meta-Pruning for Attention Heads Zhengyan Zhang Fanchao Qi Zhiyuan Liu Qun Liu Maosong Sun VLM 46 30 0 07 Nov 2020
DL-Reg: A Deep Learning Regularization Technique using Linear Regression Maryam Dialameh A. Hamzeh Hossein Rahmani 26 3 0 31 Oct 2020
Layer-adaptive sparsity for the Magnitude-based Pruning Jaeho Lee Sejun Park Sangwoo Mo SungSoo Ahn Jinwoo Shin 26 189 0 15 Oct 2020
Interpreting Graph Neural Networks for NLP With Differentiable Edge Masking M. Schlichtkrull Nicola De Cao Ivan Titov AI4CE 36 214 0 01 Oct 2020
Pruning Convolutional Filters using Batch Bridgeout Najeeb Khan Ian Stavness 28 3 0 23 Sep 2020
Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot Jingtong Su Yihang Chen Tianle Cai Tianhao Wu Ruiqi Gao Liwei Wang Jason D. Lee 16 85 0 22 Sep 2020
SparseRT: Accelerating Unstructured Sparsity on GPUs for Deep Learning Inference Ziheng Wang 40 67 0 26 Aug 2020
Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks Ting-Wu Chin Ari S. Morcos Diana Marculescu 26 10 0 23 Jul 2020
A General Family of Stochastic Proximal Gradient Methods for Deep Learning Jihun Yun A. Lozano Eunho Yang 22 12 0 15 Jul 2020
Principal Component Networks: Parameter Reduction Early in Training R. Waleffe Theodoros Rekatsinas 3DPC 19 9 0 23 Jun 2020
Revisiting Loss Modelling for Unstructured Pruning César Laurent Camille Ballas Thomas George Nicolas Ballas Pascal Vincent 32 14 0 22 Jun 2020
Sparse GPU Kernels for Deep Learning Trevor Gale Matei A. Zaharia C. Young Erich Elsen 17 230 0 18 Jun 2020
Progressive Skeletonization: Trimming more fat from a network at initialization Pau de Jorge Amartya Sanyal Harkirat Singh Behl Philip Torr Grégory Rogez P. Dokania 31 95 0 16 Jun 2020
A Framework for Neural Network Pruning Using Gibbs Distributions Alex Labach S. Valaee 9 5 0 08 Jun 2020
Movement Pruning: Adaptive Sparsity by Fine-Tuning Victor Sanh Thomas Wolf Alexander M. Rush 32 472 0 15 May 2020
Bayesian Bits: Unifying Quantization and Pruning M. V. Baalen Christos Louizos Markus Nagel Rana Ali Amjad Ying Wang Tijmen Blankevoort Max Welling MQ 18 114 0 14 May 2020
Ensembled sparse-input hierarchical networks for high-dimensional datasets Jean Feng N. Simon 19 4 0 11 May 2020
Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey Jiayi Liu S. Tripathi Unmesh Kurup Mohak Shah 3DPC MedIm 30 52 0 08 May 2020
Data-Free Network Quantization With Adversarial Knowledge Distillation Yoojin Choi Jihwan P. Choi Mostafa El-Khamy Jungwon Lee MQ 27 119 0 08 May 2020
Pruning artificial neural networks: a way to find well-generalizing, high-entropy sharp minima Enzo Tartaglione Andrea Bragagnolo Marco Grangetto 33 11 0 30 Apr 2020
Computation on Sparse Neural Networks: an Inspiration for Future Hardware Fei Sun Minghai Qin Tianyun Zhang Liu Liu Yen-kuang Chen Yuan Xie 39 7 0 24 Apr 2020
Learning to Ask Medical Questions using Reinforcement Learning Uri Shaham Tom Zahavy C. Caraballo S. Mahajan D. Massey H. Krumholz OOD 24 1 0 31 Mar 2020
SASL: Saliency-Adaptive Sparsity Learning for Neural Network Acceleration Jun Shi Jianfeng Xu K. Tasaka Zhibo Chen 6 25 0 12 Mar 2020
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 235 383 0 05 Mar 2020
Learned Threshold Pruning K. Azarian Yash Bhalgat Jinwon Lee Tijmen Blankevoort MQ 28 38 0 28 Feb 2020
How Does BN Increase Collapsed Neural Network Filters? Sheng Zhou Xinjiang Wang Ping Luo Xue Jiang Wenjie Li Wei Zhang 21 1 0 30 Jan 2020
MEMO: A Deep Network for Flexible Combination of Episodic Memories Andrea Banino Adria Puigdomenech Badia Raphael Köster Martin Chadwick V. Zambaldi Demis Hassabis Caswell Barry M. Botvinick D. Kumaran Charles Blundell KELM 26 33 0 29 Jan 2020
Quantisation and Pruning for Neural Network Compression and Regularisation Kimessha Paupamah Steven D. James Richard Klein 20 23 0 14 Jan 2020
Resource-Efficient Neural Networks for Embedded Systems Wolfgang Roth Günther Schindler Lukas Pfeifenberger Robert Peharz Sebastian Tschiatschek Holger Fröning Franz Pernkopf Zoubin Ghahramani 34 47 0 07 Jan 2020
Sparse Weight Activation Training Md Aamir Raihan Tor M. Aamodt 34 73 0 07 Jan 2020
Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery Samuel Kim Peter Y. Lu Srijon Mukherjee M. Gilbert Li Jing V. Ceperic Marin Soljacic 22 162 0 10 Dec 2019
Learning with Multiplicative Perturbations Xiulong Yang Shihao Ji AAML 30 4 0 04 Dec 2019
Fast Sparse ConvNets Erich Elsen Marat Dukhan Trevor Gale Karen Simonyan 21 151 0 21 Nov 2019
Learning Sparse Sharing Architectures for Multiple Tasks Tianxiang Sun Yunfan Shao Xiaonan Li Pengfei Liu Hang Yan Xipeng Qiu Xuanjing Huang MoE 30 128 0 12 Nov 2019
A Latent Morphology Model for Open-Vocabulary Neural Machine Translation Duygu Ataman Wilker Aziz Alexandra Birch 27 16 0 30 Oct 2019
Deep Learning at the Edge Sahar Voghoei N. Tonekaboni Jason G. Wallace H. Arabnia 21 41 0 22 Oct 2019
Image Captioning with Sparse Recurrent Neural Network J. Tan Chee Seng Chan Joon Huang Chuah VLM 29 6 0 28 Aug 2019
Adaptative Inference Cost With Convolutional Neural Mixture Models Adria Ruiz Jakob Verbeek VLM 30 22 0 19 Aug 2019
Implicit Deep Learning L. Ghaoui Fangda Gu Bertrand Travacca Armin Askari Alicia Y. Tsai AI4CE 34 176 0 17 Aug 2019
DeepCABAC: A Universal Compression Algorithm for Deep Neural Networks Simon Wiedemann H. Kirchhoffer Stefan Matlage Paul Haase Arturo Marbán ... Ahmed Osman D. Marpe H. Schwarz Thomas Wiegand Wojciech Samek 54 93 0 27 Jul 2019
Sparse Networks from Scratch: Faster Training without Losing Performance Tim Dettmers Luke Zettlemoyer 20 334 0 10 Jul 2019
Importance Estimation for Neural Network Pruning Pavlo Molchanov Arun Mallya Stephen Tyree I. Frosio Jan Kautz 3DPC 42 859 0 25 Jun 2019
Compressing RNNs for IoT devices by 15-38x using Kronecker Products Urmish Thakker Jesse G. Beu Dibakar Gope Chu Zhou Igor Fedorov Ganesh S. Dasika Matthew Mattina 27 36 0 07 Jun 2019
Feature Map Transform Coding for Energy-Efficient CNN Inference Brian Chmiel Chaim Baskin Ron Banner Evgenii Zheltonozhskii Yevgeny Yermolin Alex Karbachevsky A. Bronstein A. Mendelson 33 24 0 26 May 2019