Only Train Once: A One-Shot Neural Network Training And Pruning Framework

15 July 2021

Tianyi Chen

Papers citing "Only Train Once: A One-Shot Neural Network Training And Pruning Framework"

50 / 70 papers shown

Title
HESSO: Towards Automatic Efficient and User Friendly Any Neural Network Training and Pruning Tianyi Chen Xiaoyi Qu David Aponte Colby R. Banbury Jongwoo Ko Tianyu Ding Yong Ma Vladimir Lyapunov Ilya Zharkov Luming Liang 110 2 0 11 Sep 2024
Approximate Computing Survey, Part II: Application-Specific & Architectural Approximation Techniques and Applications Vasileios Leon Muhammad Abdullah Hanif Giorgos Armeniakos Xun Jiao Mohamed Bennai K. Pekmestzi Dimitrios Soudris 67 3 0 20 Jul 2023
N2NSkip: Learning Highly Sparse Networks using Neuron-to-Neuron Skip Connections Arvind Subramaniam Avinash Sharma 32 17 0 07 Aug 2022
CDFI: Compression-Driven Network Design for Frame Interpolation Tianyu Ding Luming Liang Zhihui Zhu Ilya Zharkov 42 94 0 18 Mar 2021
Structured Sparsity Inducing Adaptive Optimizers for Deep Learning T. Deleu Yoshua Bengio ODL 44 22 0 07 Feb 2021
SCOP: Scientific Control for Reliable Neural Network Pruning Yehui Tang Yunhe Wang Yixing Xu Dacheng Tao Chunjing Xu Chao Xu Chang Xu AAML 72 167 0 21 Oct 2020
Pruning Filter in Filter Fanxu Meng Hao Cheng Ke Li Huixiang Luo Xiao-Wei Guo Guangming Lu Xing Sun VLM 49 106 0 30 Sep 2020
Operation-Aware Soft Channel Pruning using Differentiable Masks Minsoo Kang Bohyung Han AAML 62 139 0 08 Jul 2020
EagleEye: Fast Sub-net Evaluation for Efficient Neural Network Pruning Bailin Li Bowen Wu Jiang Su Guangrun Wang Liang Lin 53 174 0 06 Jul 2020
Movement Pruning: Adaptive Sparsity by Fine-Tuning Victor Sanh Thomas Wolf Alexander M. Rush 61 475 0 15 May 2020
Bayesian Bits: Unifying Quantization and Pruning M. V. Baalen Christos Louizos Markus Nagel Rana Ali Amjad Ying Wang Tijmen Blankevoort Max Welling MQ 46 114 0 14 May 2020
$Orthant Based Proximal Stochastic Gradient Method for $\ell_1$-Regularized Optimization$ Orthant Based Proximal Stochastic Gradient Method for $\ell_1$ -Regularized Optimization Tianyi Chen Tianyu Ding Bo Ji Guanyi Wang Jing Tian Yixin Shi Sheng Yi Xiao Tu Zhihui Zhu 32 28 0 07 Apr 2020
Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression Yawei Li Shuhang Gu Christoph Mayer Luc Van Gool Radu Timofte 160 190 0 19 Mar 2020
Highly Efficient Salient Object Detection with 100K Parameters Shanghua Gao Yong-qiang Tan Ming-Ming Cheng Chengze Lu Yunpeng Chen Shuicheng Yan 253 169 0 12 Mar 2020
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 258 384 0 05 Mar 2020
Statistical Adaptive Stochastic Gradient Methods Pengchuan Zhang Hunter Lang Qiang Liu Lin Xiao ODL 34 11 0 25 Feb 2020
Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning Mitchell A. Gordon Kevin Duh Nicholas Andrews VLM 46 339 0 19 Feb 2020
A Stochastic Extra-Step Quasi-Newton Method for Nonsmooth Nonconvex Optimization Minghan Yang Andre Milzarek Zaiwen Wen Tong Zhang ODL 69 36 0 21 Oct 2019
Reducing Transformer Depth on Demand with Structured Dropout Angela Fan Edouard Grave Armand Joulin 98 588 0 25 Sep 2019
Gate Decorator: Global Filter Pruning Method for Accelerating Deep Convolutional Neural Networks Zhonghui You Kun Yan Jinmian Ye Meng Ma Ping Wang 3DPC 41 248 0 18 Sep 2019
Multi-Level Composite Stochastic Optimization via Nested Variance Reduction Junyu Zhang Lin Xiao 89 54 0 29 Aug 2019
DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity Measures Huanrui Yang W. Wen H. Li 40 97 0 27 Aug 2019
Depth-Aware Video Frame Interpolation Wenbo Bao Wei-Sheng Lai Chao Ma Xiaoyun Zhang Zhiyong Gao Ming-Hsuan Yang MDE 109 498 0 01 Apr 2019
The State of Sparsity in Deep Neural Networks Trevor Gale Erich Elsen Sara Hooker 113 755 0 25 Feb 2019
PruneTrain: Fast Neural Network Training by Dynamic Sparse Model Reconfiguration Sangkug Lym Esha Choukse Siavash Zangeneh W. Wen Sujay Sanghavi M. Erez CVBM 23 87 0 26 Jan 2019
Towards Compact ConvNets via Structure-Sparsity Regularized Filter Pruning Shaohui Lin Rongrong Ji Yuchao Li Cheng Deng Xuelong Li 55 70 0 23 Jan 2019
On the Ineffectiveness of Variance Reduced Optimization for Deep Learning Aaron Defazio Léon Bottou UQCV DRL 40 112 0 11 Dec 2018
Exploiting Kernel Sparsity and Entropy for Interpretable CNN Compression Yuchao Li Shaohui Lin Baochang Zhang Jianzhuang Liu David Doermann Yongjian Wu Feiyue Huang Rongrong Ji 53 130 0 11 Dec 2018
Accelerate CNN via Recursive Bayesian Pruning Yuefu Zhou Ya Zhang Yanfeng Wang Qi Tian BDL 35 58 0 02 Dec 2018
SNIP: Single-shot Network Pruning based on Connection Sensitivity Namhoon Lee Thalaiyasingam Ajanthan Philip Torr VLM 217 1,190 0 04 Oct 2018
Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks Yang He Guoliang Kang Xuanyi Dong Yanwei Fu Yi Yang AAML VLM 55 960 0 21 Aug 2018
Video-to-Video Synthesis Ting-Chun Wang Ming-Yuan Liu Jun-Yan Zhu Guilin Liu Andrew Tao Jan Kautz Bryan Catanzaro GAN VGen 89 987 0 20 Aug 2018
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator Cong Fang C. J. Li Zhouchen Lin Tong Zhang 81 572 0 04 Jul 2018
A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multipliers Tianyun Zhang Shaokai Ye Kaiqi Zhang Jian Tang Wujie Wen M. Fardad Yanzhi Wang 54 435 0 10 Apr 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 183 3,433 0 09 Mar 2018
Escoin: Efficient Sparse Convolutional Neural Network Inference on GPUs Xuhao Chen 64 25 0 28 Feb 2018
AMC: AutoML for Model Compression and Acceleration on Mobile Devices Yihui He Ji Lin Zhijian Liu Hanrui Wang Li Li Song Han 80 1,348 0 10 Feb 2018
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Richard Y. Zhang Phillip Isola Alexei A. Efros Eli Shechtman Oliver Wang EGVM 309 11,610 0 11 Jan 2018
A Survey of Model Compression and Acceleration for Deep Neural Networks Yu Cheng Duo Wang Pan Zhou Zhang Tao 68 1,094 0 23 Oct 2017
Combinatorial Penalties: Which structures are preserved by convex relaxations? Marwa El Halabi Francis R. Bach Volkan Cevher 51 16 0 17 Oct 2017
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 201 8,807 0 25 Aug 2017
Video Frame Interpolation via Adaptive Separable Convolution Simon Niklaus Long Mai Feng Liu 94 699 0 05 Aug 2017
ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression Jian-Hao Luo Jianxin Wu Weiyao Lin 49 1,758 0 20 Jul 2017
Channel Pruning for Accelerating Very Deep Neural Networks Yihui He Xiangyu Zhang Jian Sun 194 2,519 0 19 Jul 2017
Data-Driven Sparse Structure Selection for Deep Neural Networks Zehao Huang Naiyan Wang 79 561 0 05 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 519 129,831 0 12 Jun 2017
Bayesian Compression for Deep Learning Christos Louizos Karen Ullrich Max Welling UQCV BDL 127 479 0 24 May 2017
Structured Bayesian Pruning via Log-Normal Multiplicative Noise Kirill Neklyudov Dmitry Molchanov Arsenii Ashukha Dmitry Vetrov BDL 103 188 0 20 May 2017
Gap Safe screening rules for sparsity enforcing penalties Eugène Ndiaye Olivier Fercoq Alexandre Gramfort Joseph Salmon 58 125 0 17 Nov 2016
Pruning Filters for Efficient ConvNets Hao Li Asim Kadav Igor Durdanovic H. Samet H. Graf 3DPC 175 3,687 0 31 Aug 2016