How much pre-training is enough to discover a good subnetwork?

v1v2v3 (latest)

How much pre-training is enough to discover a good subnetwork?

31 July 2021

Cameron R. Wolfe

Junhyung Lyle Kim

Anastasios Kyrillidis

ArXiv (abs)PDF HTML

Papers citing "How much pre-training is enough to discover a good subnetwork?"

14 / 64 papers shown

Title
To prune, or not to prune: exploring the efficacy of pruning for model compression Michael Zhu Suyog Gupta 202 1,282 0 05 Oct 2017
Learning Efficient Convolutional Networks through Network Slimming Zhuang Liu Jianguo Li Zhiqiang Shen Gao Huang Shoumeng Yan Changshui Zhang 138 2,427 0 22 Aug 2017
ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression Jian-Hao Luo Jianxin Wu Weiyao Lin 58 1,761 0 20 Jul 2017
Channel Pruning for Accelerating Very Deep Neural Networks Yihui He Xiangyu Zhang Jian Sun 210 2,531 0 19 Jul 2017
Forward Thinking: Building and Training Neural Networks One Layer at a Time Chris Hettinger Tanner Christensen Ben Ehlert J. Humpherys Tyler J. Jarvis Sean Wade AI4CE 50 45 0 08 Jun 2017
Convergence Analysis of Two-layer Neural Networks with ReLU Activation Yuanzhi Li Yang Yuan MLT 166 653 0 28 May 2017
Decentralized Frank-Wolfe Algorithm for Convex and Non-convex Problems Hoi-To Wai Jean Lafond Anna Scaglione Eric Moulines 113 90 0 05 Dec 2016
Pruning Filters for Efficient ConvNets Hao Li Asim Kadav Igor Durdanovic H. Samet H. Graf 3DPC 195 3,707 0 31 Aug 2016
EIE: Efficient Inference Engine on Compressed Deep Neural Network Song Han Xingyu Liu Huizi Mao Jing Pu A. Pedram M. Horowitz W. Dally 132 2,461 0 04 Feb 2016
Structured Pruning of Deep Convolutional Neural Networks S. Anwar Kyuyeon Hwang Wonyong Sung 134 748 0 29 Dec 2015
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.3K 194,641 0 10 Dec 2015
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding Song Han Huizi Mao W. Dally 3DGS 263 8,864 0 01 Oct 2015
Breaking the Curse of Dimensionality with Convex Neural Networks Francis R. Bach 196 706 0 30 Dec 2014
A Distributed Frank-Wolfe Algorithm for Communication-Efficient Sparse Learning A. Bellet Yingyu Liang A. Garakani Maria-Florina Balcan Fei Sha FedML 105 49 0 09 Apr 2014