v1v2v3v4v5v6v7v8v9 (latest)

A Survey of Model Compression and Acceleration for Deep Neural Networks

23 October 2017

Papers citing "A Survey of Model Compression and Acceleration for Deep Neural Networks"

50 / 90 papers shown

Title
Online Difficulty Filtering for Reasoning Oriented Reinforcement Learning Sanghwan Bae Jiwoo Hong Min Young Lee Hanbyul Kim Jeongyeon Nam Donghyun Kwak OffRL LRM 107 0 0 04 Apr 2025
Data Generation for Hardware-Friendly Post-Training Quantization Lior Dikstein Ariel Lapid Arnon Netzer H. Habi MQ 445 0 0 29 Oct 2024
Accelerating the Low-Rank Decomposed Models Habib Hajimolahoseini Walid Ahmed Austin Wen Yang Liu 77 0 0 24 Jul 2024
Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging Deyuan Liu Zhan Qin Han Wang Zhao Yang Zecheng Wang ... Zhao Lv Zhiying Tu Dianhui Chu Bo Li Dianbo Sui 83 2 0 24 Jun 2024
Compress then Serve: Serving Thousands of LoRA Adapters with Little Overhead Rickard Brüel-Gabrielsson Jiacheng Zhu Onkar Bhardwaj Leshem Choshen Kristjan Greenewald Mikhail Yurochkin Justin Solomon 117 9 0 17 Jun 2024
Tiny Models are the Computational Saver for Large Models Qingyuan Wang B. Cardiff Antoine Frappé Benoît Larras Deepu John 82 2 0 26 Mar 2024
Training Acceleration of Low-Rank Decomposed Networks using Sequential Freezing and Rank Quantization Habib Hajimolahoseini Walid Ahmed Yang Liu OffRL MQ 60 7 0 07 Sep 2023
Optimal Lottery Tickets via SubsetSum: Logarithmic Over-Parameterization is Sufficient Ankit Pensia Shashank Rajput Alliot Nagle Harit Vishwakarma Dimitris Papailiopoulos 58 103 0 14 Jun 2020
Differentiable Neural Input Search for Recommender Systems Weiyu Cheng Yanyan Shen Linpeng Huang 69 36 0 08 Jun 2020
Spiking neural networks trained with backpropagation for low power neuromorphic implementation of voice activity detection Flavio Martinelli Giorgia Dellaferrera Pablo Mainar Milos Cernak 36 31 0 22 Oct 2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 234 7,520 0 02 Oct 2019
UNITER: UNiversal Image-TExt Representation Learning Yen-Chun Chen Linjie Li Licheng Yu Ahmed El Kholy Faisal Ahmed Zhe Gan Yu Cheng Jingjing Liu VLM OT 110 447 0 25 Sep 2019
Patient Knowledge Distillation for BERT Model Compression S. Sun Yu Cheng Zhe Gan Jingjing Liu 134 837 0 25 Aug 2019
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware Han Cai Ligeng Zhu Song Han 102 1,867 0 02 Dec 2018
HAQ: Hardware-Aware Automated Quantization with Mixed Precision Kuan-Chieh Wang Zhijian Liu Chengyue Wu Ji Lin Song Han MQ 127 882 0 21 Nov 2018
Rethinking the Value of Network Pruning Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang Trevor Darrell 36 1,470 0 11 Oct 2018
DARTS: Differentiable Architecture Search Hanxiao Liu Karen Simonyan Yiming Yang 199 4,355 0 24 Jun 2018
Detail-Preserving Pooling in Deep Networks Faraz Saeedan Nicolas Weber Michael Goesele Stefan Roth 92 91 0 11 Apr 2018
AMC: AutoML for Model Compression and Acceleration on Mobile Devices Yihui He Ji Lin Zhijian Liu Hanrui Wang Li Li Song Han 95 1,347 0 10 Feb 2018
MobileNetV2: Inverted Residuals and Linear Bottlenecks Mark Sandler Andrew G. Howard Menglong Zhu A. Zhmoginov Liang-Chieh Chen 184 19,284 0 13 Jan 2018
Convolutional Networks with Adaptive Inference Graphs Andreas Veit Serge J. Belongie OOD GNN 95 385 0 30 Nov 2017
BlockDrop: Dynamic Inference Paths in Residual Networks Zuxuan Wu Tushar Nagarajan Abhishek Kumar Steven J. Rennie L. Davis Kristen Grauman Rogerio Feris 95 466 0 22 Nov 2017
Sobolev GAN Youssef Mroueh Chun-Liang Li Tom Sercu Anant Raj Yu Cheng 45 117 0 14 Nov 2017
Learning Efficient Convolutional Networks through Network Slimming Zhuang Liu Jianguo Li Zhiqiang Shen Gao Huang Shoumeng Yan Changshui Zhang 125 2,421 0 22 Aug 2017
Channel Pruning for Accelerating Very Deep Neural Networks Yihui He Xiangyu Zhang Jian Sun 204 2,525 0 19 Jul 2017
DarkRank: Accelerating Deep Metric Learning via Cross Sample Similarities Transfer Yuntao Chen Naiyan Wang Zhaoxiang Zhang FedML 95 222 0 05 Jul 2017
Data-Driven Sparse Structure Selection for Deep Neural Networks Zehao Huang Naiyan Wang 83 563 0 05 Jul 2017
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 1.2K 20,858 0 17 Apr 2017
Soft Weight-Sharing for Neural Network Compression Karen Ullrich Edward Meeds Max Welling 167 417 0 13 Feb 2017
Deep Learning with Low Precision by Half-wave Gaussian Quantization Zhaowei Cai Xiaodong He Jian Sun Nuno Vasconcelos MQ 136 505 0 03 Feb 2017
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer Noam M. Shazeer Azalia Mirhoseini Krzysztof Maziarz Andy Davis Quoc V. Le Geoffrey E. Hinton J. Dean MoE 251 2,653 0 23 Jan 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 125 2,581 0 12 Dec 2016
Towards the Limit of Network Quantization Yoojin Choi Mostafa El-Khamy Jungwon Lee MQ 50 194 0 05 Dec 2016
Deep Pyramidal Residual Networks with Separated Stochastic Depth Yoshihiro Yamada Masakazu Iwamura K. Kise 51 27 0 05 Dec 2016
Trained Ternary Quantization Chenzhuo Zhu Song Han Huizi Mao W. Dally MQ 137 1,035 0 04 Dec 2016
SqueezeDet: Unified, Small, Low Power Fully Convolutional Neural Networks for Real-Time Object Detection for Autonomous Driving Bichen Wu Alvin Wan F. Iandola Peter H. Jin Kurt Keutzer 90 513 0 04 Dec 2016
Speed/accuracy trade-offs for modern convolutional object detectors Jonathan Huang V. Rathod Chen Sun Menglong Zhu Anoop Korattikara Balan ... Ian S. Fischer Z. Wojna Yang Song S. Guadarrama Kevin Patrick Murphy 3DH 3DV 100 2,572 0 30 Nov 2016
Learning the Number of Neurons in Deep Networks J. Álvarez Mathieu Salzmann 185 413 0 19 Nov 2016
Fully-adaptive Feature Sharing in Multi-Task Networks with Applications in Person Attribute Classification Y. Lu Abhishek Kumar Shuangfei Zhai Yu Cheng T. Javidi Rogerio Feris 3DH 52 387 0 16 Nov 2016
S3Pool: Pooling with Stochastic Spatial Sampling Shuangfei Zhai Hui Wu Abhishek Kumar Yu Cheng Y. Lu Zhongfei Zhang Rogerio Feris 48 79 0 16 Nov 2016
Loss-aware Binarization of Deep Networks Lu Hou Quanming Yao James T. Kwok MQ 70 220 0 05 Nov 2016
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 468 5,373 0 05 Nov 2016
Doubly Convolutional Neural Networks Shuangfei Zhai Yu Cheng Weining Lu Zhongfei Zhang OOD 3DV 48 63 0 30 Oct 2016
HyperNetworks David R Ha Andrew M. Dai Quoc V. Le 140 1,630 0 27 Sep 2016
Pruning Filters for Efficient ConvNets Hao Li Asim Kadav Igor Durdanovic H. Samet H. Graf 3DPC 193 3,697 0 31 Aug 2016
Learning Structured Sparsity in Deep Neural Networks W. Wen Chunpeng Wu Yandan Wang Yiran Chen Hai Helen Li 181 2,339 0 12 Aug 2016
Learning to learn by gradient descent by gradient descent Marcin Andrychowicz Misha Denil Sergio Gomez Colmenarejo Matthew W. Hoffman David Pfau Tom Schaul Brendan Shillingford Nando de Freitas 113 2,006 0 14 Jun 2016
Deep neural networks are robust to weight binarization and other non-linear distortions P. Merolla R. Appuswamy John V. Arthur S. K. Esser D. Modha OOD MQ 88 96 0 07 Jun 2016
Multi-Bias Non-linear Activation in Deep Neural Networks Hongyang Li Wanli Ouyang Xiaogang Wang 56 64 0 03 Apr 2016
Deep Networks with Stochastic Depth Gao Huang Yu Sun Zhuang Liu Daniel Sedra Kilian Q. Weinberger 215 2,357 0 30 Mar 2016