Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM)

1 October 2021

Jie Bu

Arka Daw

M. Maruf

Anuj Karpatne

ArXiv (abs)PDF HTML

Papers citing "Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM)"

31 / 31 papers shown

Title
B-FPGM: Lightweight Face Detection via Bayesian-Optimized Soft FPGM Pruning Nikolaos Kaparinos Vasileios Mezaris CVBM 149 0 0 28 Jan 2025
Network Pruning That Matters: A Case Study on Retraining Variants Duong H. Le Binh-Son Hua 86 41 0 07 May 2021
ChipNet: Budget-Aware Pruning with Heaviside Continuous Approximations Rishabh Tiwari Udbhav Bamba Arnav Chavan D. K. Gupta 59 31 0 14 Feb 2021
Quadratic Residual Networks: A New Class of Neural Networks for Solving Forward and Inverse Problems in Physics Involving PDEs Jie Bu Anuj Karpatne 74 52 0 20 Jan 2021
AdaBelief Optimizer: Adapting Stepsizes by the Belief in Observed Gradients Juntang Zhuang Tommy M. Tang Yifan Ding S. Tatikonda Nicha Dvornek X. Papademetris James S. Duncan ODL 192 518 0 15 Oct 2020
Graph InfoClust: Leveraging cluster-level node information for unsupervised graph representation learning Costas Mavromatis George Karypis 63 55 0 15 Sep 2020
Implicit Neural Representations with Periodic Activation Functions Vincent Sitzmann Julien N. P. Martel Alexander W. Bergman David B. Lindell Gordon Wetzstein AI4TS 174 2,579 0 17 Jun 2020
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 283 1,054 0 06 Mar 2020
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 304 388 0 05 Mar 2020
Linear Mode Connectivity and the Lottery Ticket Hypothesis Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy Michael Carbin MoMe 163 630 0 11 Dec 2019
Winning the Lottery with Continuous Sparsification Pedro H. P. Savarese Hugo Silva Michael Maire 87 137 0 10 Dec 2019
Orthogonal Convolutional Neural Networks Jiayun Wang Yubei Chen Rudrasis Chakraborty Stella X. Yu 85 190 0 27 Nov 2019
Rigging the Lottery: Making All Tickets Winners Utku Evci Trevor Gale Jacob Menick Pablo Samuel Castro Erich Elsen 199 609 0 25 Nov 2019
Few Shot Network Compression via Cross Distillation Haoli Bai Jiaxiang Wu Irwin King Michael Lyu FedML 78 60 0 21 Nov 2019
Mutual Information Maximization in Graph Neural Networks Xinhan Di Pengqian Yu Rui Bu Mingchao Sun 63 21 0 21 May 2019
Similarity of Neural Network Representations Revisited Simon Kornblith Mohammad Norouzi Honglak Lee Geoffrey E. Hinton 143 1,436 0 01 May 2019
Inductive Matrix Completion Based on Graph Neural Networks Muhan Zhang Yixin Chen 91 237 0 26 Apr 2019
The State of Sparsity in Deep Neural Networks Trevor Gale Erich Elsen Sara Hooker 167 763 0 25 Feb 2019
Rethinking the Value of Network Pruning Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang Trevor Darrell 42 1,477 0 11 Oct 2018
SNIP: Single-shot Network Pruning based on Connection Sensitivity Namhoon Lee Thalaiyasingam Ajanthan Philip Torr VLM 274 1,212 0 04 Oct 2018
Hyperspherical Variational Auto-Encoders Tim R. Davidson Luca Falorsi Nicola De Cao Thomas Kipf Jakub M. Tomczak DRL BDL 120 384 0 03 Apr 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 277 3,489 0 09 Mar 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 95 643 0 14 Feb 2018
MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks A. Gordon Elad Eban Ofir Nachum Bo Chen Hao Wu Tien-Ju Yang Edward Choi 74 339 0 18 Nov 2017
To prune, or not to prune: exploring the efficacy of pruning for model compression Michael Zhu Suyog Gupta 202 1,282 0 05 Oct 2017
Learning Efficient Convolutional Networks through Network Slimming Zhuang Liu Jianguo Li Zhiqiang Shen Gao Huang Shoumeng Yan Changshui Zhang 140 2,427 0 22 Aug 2017
Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Science Decebal Constantin Mocanu Elena Mocanu Peter Stone Phuong H. Nguyen M. Gibescu A. Liotta 184 637 0 15 Jul 2017
Pruning Filters for Efficient ConvNets Hao Li Asim Kadav Igor Durdanovic H. Samet H. Graf 3DPC 195 3,707 0 31 Aug 2016
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 316 6,715 0 08 Jun 2015
Auto-Encoding Variational Bayes Diederik P. Kingma Max Welling BDL 484 16,922 0 20 Dec 2013
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 288 12,467 0 24 Jun 2012