v1v2 (latest)

Rethinking the Value of Network Pruning

11 October 2018

Gao Huang

Papers citing "Rethinking the Value of Network Pruning"

50 / 757 papers shown

Title
Soft Threshold Weight Reparameterization for Learnable Sparsity Aditya Kusupati Vivek Ramanujan Raghav Somani Mitchell Wortsman Prateek Jain Sham Kakade Ali Farhadi 197 247 0 08 Feb 2020
Activation Density driven Energy-Efficient Pruning in Training Timothy Foldy-Porto Yeshwanth Venkatesha Priyadarshini Panda 45 4 0 07 Feb 2020
BABO: Background Activation Black-Out for Efficient Object Detection Byungseok Roh Hankyu Cho Myung-Ho Ju Soon Hyung Pyo ObjD 18 1 0 05 Feb 2020
Lightweight Convolutional Representations for On-Device Natural Language Processing Shrey Desai Geoffrey Goh Arun Babu Ahmed Aly AI4TS 46 8 0 04 Feb 2020
Search for Better Students to Learn Distilled Knowledge Jindong Gu Volker Tresp 52 19 0 30 Jan 2020
Pre-defined Sparsity for Low-Complexity Convolutional Neural Networks Souvik Kundu M. Nazemi Massoud Pedram K. Chugg Peter A. Beerel CVBM 77 36 0 29 Jan 2020
SS-Auto: A Single-Shot, Automatic Structured Weight Pruning Framework of DNNs with Ultra-High Efficiency Zechao Li Yifan Gong Xiaolong Ma Sijia Liu Mengshu Sun Zheng Zhan Zhenglun Kong Geng Yuan Yanzhi Wang 53 17 0 23 Jan 2020
Channel Pruning via Automatic Structure Search Mingbao Lin Rongrong Ji Yuxin Zhang Baochang Zhang Yongjian Wu Yonghong Tian 130 247 0 23 Jan 2020
An Image Enhancing Pattern-based Sparsity for Real-time Inference on Mobile Devices Xiaolong Ma Wei Niu Tianyun Zhang Sijia Liu Sheng Lin ... Xiang Chen Jian Tang Kaisheng Ma Bin Ren Yanzhi Wang 103 27 0 20 Jan 2020
On Iterative Neural Network Pruning, Reinitialization, and the Similarity of Masks Michela Paganini Jessica Zosa Forde 84 19 0 14 Jan 2020
Pruning Convolutional Neural Networks with Self-Supervision Mathilde Caron Ari S. Morcos Piotr Bojanowski Julien Mairal Armand Joulin SSL 3DPC 59 12 0 10 Jan 2020
Resource-Efficient Neural Networks for Embedded Systems Wolfgang Roth Günther Schindler Lukas Pfeifenberger Robert Peharz Sebastian Tschiatschek Holger Fröning Franz Pernkopf Zoubin Ghahramani 88 51 0 07 Jan 2020
Discrimination-aware Network Pruning for Deep Model Compression Jing Liu Bohan Zhuang Zhuangwei Zhuang Yong Guo Junzhou Huang Jin-Hui Zhu Mingkui Tan CVBM 76 121 0 04 Jan 2020
Deep learning architectures for nonlinear operator functions and nonlinear inverse problems Maarten V. de Hoop Matti Lassas C. Wong 78 26 0 23 Dec 2019
Landscape Connectivity and Dropout Stability of SGD Solutions for Over-parameterized Neural Networks Aleksandr Shevchenko Marco Mondelli 196 38 0 20 Dec 2019
Taxonomy and Evaluation of Structured Compression of Convolutional Neural Networks Andrey Kuzmin Markus Nagel Saurabh Pitre Sandeep Pendyam Tijmen Blankevoort Max Welling 75 27 0 20 Dec 2019
AtomNAS: Fine-Grained End-to-End Neural Architecture Search Jieru Mei Yingwei Li Xiaochen Lian Xiaojie Jin Linjie Yang Alan Yuille Jianchao Yang 58 107 0 20 Dec 2019
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 137 169 0 19 Dec 2019
Joint Architecture and Knowledge Distillation in CNN for Chinese Text Recognition Zirui Wang Jun Du 37 0 0 17 Dec 2019
WaLDORf: Wasteless Language-model Distillation On Reading-comprehension J. Tian A. Kreuzer Pai-Hung Chen Hans-Martin Will VLM 60 3 0 13 Dec 2019
Linear Mode Connectivity and the Lottery Ticket Hypothesis Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy Michael Carbin MoMe 183 630 0 11 Dec 2019
The Search for Sparse, Robust Neural Networks J. Cosentino Federico Zaiter Dan Pei Jun Zhu AAML OOD 45 18 0 05 Dec 2019
One-Shot Pruning of Recurrent Neural Networks by Jacobian Spectrum Evaluation Matthew Shunshi Zhang Bradly C. Stadie 60 32 0 30 Nov 2019
QKD: Quantization-aware Knowledge Distillation Jangho Kim Yash Bhalgat Jinwon Lee Chirag I. Patel Nojun Kwak MQ 100 66 0 28 Nov 2019
GhostNet: More Features from Cheap Operations Kai Han Yunhe Wang Qi Tian Jianyuan Guo Chunjing Xu Chang Xu 114 2,717 0 27 Nov 2019
Structured Multi-Hashing for Model Compression Elad Eban Yair Movshovitz-Attias Hao Wu Mark Sandler Andrew Poon Yerlan Idelbayev M. A. Carreira-Perpiñán 78 18 0 25 Nov 2019
Rigging the Lottery: Making All Tickets Winners Utku Evci Trevor Gale Jacob Menick Pablo Samuel Castro Erich Elsen 233 612 0 25 Nov 2019
A SOT-MRAM-based Processing-In-Memory Engine for Highly Compressed DNN Implementation Geng Yuan Xiaolong Ma Sheng Lin Zechao Li Caiwen Ding 50 8 0 24 Nov 2019
Few Shot Network Compression via Cross Distillation Haoli Bai Jiaxiang Wu Irwin King Michael Lyu FedML 95 60 0 21 Nov 2019
EfficientDet: Scalable and Efficient Object Detection Mingxing Tan Ruoming Pang Quoc V. Le 254 5,125 0 20 Nov 2019
CUP: Cluster Pruning for Compressing Deep Neural Networks Rahul Duggal Cao Xiao R. Vuduc Jimeng Sun 3DPC VLM 48 23 0 19 Nov 2019
Neural Network Pruning with Residual-Connections and Limited-Data Jian-Hao Luo Jianxin Wu 95 118 0 19 Nov 2019
DARB: A Density-Aware Regular-Block Pruning for Deep Neural Networks Ao Ren Tao Zhang Yuhao Wang Sheng Lin Zhaoyang Han Yen-kuang Chen Yuan Xie Yanzhi Wang 78 11 0 19 Nov 2019
Provable Filter Pruning for Efficient Neural Networks Lucas Liebenwein Cenk Baykal Harry Lang Dan Feldman Daniela Rus VLM 3DPC 91 141 0 18 Nov 2019
Active Subspace of Neural Networks: Structural Analysis and Universal Attacks Chunfeng Cui Kaiqi Zhang Talgat Daulbaev Julia Gusak Ivan Oseledets Zheng Zhang AAML 61 25 0 29 Oct 2019
Evaluating Lottery Tickets Under Distributional Shifts Shrey Desai Hongyuan Zhan Ahmed Aly UQCV OOD 88 41 0 28 Oct 2019
Cross-Channel Intragroup Sparsity Neural Network Zhilin Yu Chao Wang Xin Wang Qing Wu Yong Zhao Xundong Wu 35 1 0 26 Oct 2019
FireNet: Real-time Segmentation of Fire Perimeter from Aerial Video Jigar Doshi Dominic Garcia Cliff Massey Pablo Llueca Nicolas Borensztein Michael Baird Matthew Cook Devaki Raj 71 11 0 14 Oct 2019
SiPPing Neural Networks: Sensitivity-informed Provable Pruning of Neural Networks Cenk Baykal Lucas Liebenwein Igor Gilitschenski Dan Feldman Daniela Rus 92 18 0 11 Oct 2019
Differentiable Sparsification for Deep Neural Networks Yognjin Lee 72 7 0 08 Oct 2019
Energy-Aware Neural Architecture Optimization with Fast Splitting Steepest Descent Dilin Wang Meng Li Lemeng Wu Vikas Chandra Qiang Liu 111 21 0 07 Oct 2019
Splitting Steepest Descent for Growing Neural Architectures Qiang Liu Lemeng Wu Dilin Wang 113 63 0 06 Oct 2019
ConfusionFlow: A model-agnostic visualization for temporal analysis of classifier confusion A. Hinterreiter Peter Ruch Holger Stitz Martin Ennemoser J. Bernard Hendrik Strobelt M. Streit 83 46 0 02 Oct 2019
Student Specialization in Deep ReLU Networks With Finite Width and Input Dimension Yuandong Tian MLT 60 8 0 30 Sep 2019
Test-Time Training with Self-Supervision for Generalization under Distribution Shifts Yu Sun Xiaolong Wang Zhuang Liu John Miller Alexei A. Efros Moritz Hardt TTA OOD 99 96 0 29 Sep 2019
Global Sparse Momentum SGD for Pruning Very Deep Neural Networks Xiaohan Ding Guiguang Ding Xiangxin Zhou Yuchen Guo Jungong Han Ji Liu 131 165 0 27 Sep 2019
Pruning from Scratch Yulong Wang Xiaolu Zhang Lingxi Xie Jun Zhou Hang Su Bo Zhang Xiaolin Hu 77 196 0 27 Sep 2019
Optimizing Speech Recognition For The Edge Yuan Shangguan Jian Li Qiao Liang R. Álvarez Ian McGraw 87 64 0 26 Sep 2019
Reducing Transformer Depth on Demand with Structured Dropout Angela Fan Edouard Grave Armand Joulin 160 597 0 25 Sep 2019
Gate Decorator: Global Filter Pruning Method for Accelerating Deep Convolutional Neural Networks Zhonghui You Kun Yan Jinmian Ye Meng Ma Ping Wang 3DPC 93 252 0 18 Sep 2019