Accelerating Convolutional Neural Networks via Activation Map Compression

10 December 2018

Papers citing "Accelerating Convolutional Neural Networks via Activation Map Compression"

45 / 45 papers shown

Title
Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representation Tiansheng Wen Yifei Wang Zequn Zeng Zhong Peng Yudi Su Xinyang Liu Bo Chen Hongwei Liu Stefanie Jegelka Chenyu You CLL 177 4 0 03 Mar 2025
Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training Jared Fernandez Luca Wehrstedt Leonid Shamis Mostafa Elhoushi Kalyan Saladi Yonatan Bisk Emma Strubell Jacob Kahn 431 3 0 20 Nov 2024
Emergent representations in networks trained with the Forward-Forward algorithm Niccolo Tosato Lorenzo Basile Emanuele Ballarin Giuseppe de Alteriis Alberto Cazzaniga A. Ansuini 46 9 0 26 May 2023
DNN Feature Map Compression using Learned Representation over GF(2) Denis A. Gudovskiy Alec Hodgkinson Luca Rigazio 34 18 0 15 Aug 2018
Stochastic Activation Pruning for Robust Adversarial Defense Guneet Singh Dhillon Kamyar Azizzadenesheli Zachary Chase Lipton Jeremy Bernstein Jean Kossaifi Aran Khanna Anima Anandkumar AAML 62 546 0 05 Mar 2018
MobileNetV2: Inverted Residuals and Linear Bottlenecks Mark Sandler Andrew G. Howard Menglong Zhu A. Zhmoginov Liang-Chieh Chen 171 19,204 0 13 Jan 2018
Learning Sparse Neural Networks through $L_0$ Regularization Christos Louizos Max Welling Diederik P. Kingma 393 1,144 0 04 Dec 2017
Weightless: Lossy Weight Encoding For Deep Neural Network Compression Brandon Reagen Udit Gupta Bob Adolf Michael Mitzenmacher Alexander M. Rush Gu-Yeon Wei David Brooks 52 38 0 13 Nov 2017
Multi-Layer Convolutional Sparse Modeling: Pursuit and Dictionary Learning Jeremias Sulam Vardan Papyan Yaniv Romano Michael Elad 86 111 0 29 Aug 2017
Revisiting Activation Regularization for Language RNNs Stephen Merity Bryan McCann R. Socher 57 44 0 03 Aug 2017
ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression Jian-Hao Luo Jianxin Wu Weiyao Lin 52 1,760 0 20 Jul 2017
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices Xiangyu Zhang Xinyu Zhou Mengxiao Lin Jian Sun AI4TS 132 6,850 0 04 Jul 2017
Bayesian Compression for Deep Learning Christos Louizos Karen Ullrich Max Welling UQCV BDL 153 479 0 24 May 2017
SCNN: An Accelerator for Compressed-sparse Convolutional Neural Networks A. Parashar Minsoo Rhu Anurag Mukkara A. Puglielli Rangharajan Venkatesan Brucek Khailany J. Emer S. Keckler W. Dally 70 1,125 0 23 May 2017
Structured Bayesian Pruning via Log-Normal Multiplicative Noise Kirill Neklyudov Dmitry Molchanov Arsenii Ashukha Dmitry Vetrov BDL 127 188 0 20 May 2017
Compressing DMA Engine: Leveraging Activation Sparsity for Training Deep Neural Networks Minsoo Rhu Mike O'Connor Niladrish Chatterjee Jeff Pool S. Keckler 54 177 0 03 May 2017
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 1.1K 20,813 0 17 Apr 2017
More is Less: A More Complicated Network with Less Inference Complexity Xuanyi Dong Junshi Huang Yi Yang Shuicheng Yan 48 288 0 25 Mar 2017
Soft Weight-Sharing for Neural Network Compression Karen Ullrich Edward Meeds Max Welling 156 417 0 13 Feb 2017
Deep Learning with Low Precision by Half-wave Gaussian Quantization Zhaowei Cai Xiaodong He Jian Sun Nuno Vasconcelos MQ 136 505 0 03 Feb 2017
Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations Itay Hubara Matthieu Courbariaux Daniel Soudry Ran El-Yaniv Yoshua Bengio MQ 140 1,862 0 22 Sep 2016
Pruning Filters for Efficient ConvNets Hao Li Asim Kadav Igor Durdanovic H. Samet H. Graf 3DPC 188 3,693 0 31 Aug 2016
Dynamic Network Surgery for Efficient DNNs Yiwen Guo Anbang Yao Yurong Chen 79 1,058 0 16 Aug 2016
Learning Structured Sparsity in Deep Neural Networks W. Wen Chunpeng Wu Yandan Wang Yiran Chen Hai Helen Li 166 2,337 0 12 Aug 2016
Faster CNNs with Direct Sparse Convolutions and Guided Pruning Jongsoo Park Sheng Li W. Wen P. T. P. Tang Hai Helen Li Yiran Chen Pradeep Dubey 65 183 0 04 Aug 2016
Convolutional Neural Networks Analyzed via Convolutional Sparse Coding Vardan Papyan Yaniv Romano Michael Elad 82 285 0 27 Jul 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 354 10,467 0 21 Jul 2016
Deep Roots: Improving CNN Efficiency with Hierarchical Filter Groups Yani Andrew Ioannou D. Robertson R. Cipolla A. Criminisi 72 264 0 20 May 2016
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks Mohammad Rastegari Vicente Ordonez Joseph Redmon Ali Farhadi MQ 159 4,350 0 16 Mar 2016
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size F. Iandola Song Han Matthew W. Moskewicz Khalid Ashraf W. Dally Kurt Keutzer 139 7,465 0 24 Feb 2016
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning Christian Szegedy Sergey Ioffe Vincent Vanhoucke Alexander A. Alemi 365 14,223 0 23 Feb 2016
EIE: Efficient Inference Engine on Compressed Deep Neural Network Song Han Xingyu Liu Huizi Mao Jing Pu A. Pedram M. Horowitz W. Dally 118 2,455 0 04 Feb 2016
Quantized Convolutional Neural Networks for Mobile Devices Jiaxiang Wu Cong Leng Yuhang Wang Qinghao Hu Jian Cheng MQ 83 1,165 0 21 Dec 2015
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.1K 193,426 0 10 Dec 2015
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 804 27,303 0 02 Dec 2015
Training CNNs with Low-Rank Filters for Efficient Image Classification Yani Andrew Ioannou D. Robertson Jamie Shotton R. Cipolla A. Criminisi 62 152 0 20 Nov 2015
Fixed Point Quantization of Deep Convolutional Networks D. Lin S. Talathi V. Annapureddy MQ 90 814 0 19 Nov 2015
BinaryConnect: Training Deep Neural Networks with binary weights during propagations Matthieu Courbariaux Yoshua Bengio J. David MQ 198 2,984 0 02 Nov 2015
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding Song Han Huizi Mao W. Dally 3DGS 243 8,821 0 01 Oct 2015
Fast ConvNets Using Group-wise Brain Damage V. Lebedev Victor Lempitsky AAML 165 449 0 08 Jun 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 432 43,234 0 11 Feb 2015
Deep Learning with Limited Numerical Precision Suyog Gupta A. Agrawal K. Gopalakrishnan P. Narayanan HAI 185 2,046 0 09 Feb 2015
Compressing Deep Convolutional Networks using Vector Quantization Yunchao Gong Liu Liu Ming Yang Lubomir D. Bourdev MQ 136 1,170 0 18 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.5K 100,213 0 04 Sep 2014
Speeding up Convolutional Neural Networks with Low Rank Expansions Max Jaderberg Andrea Vedaldi Andrew Zisserman 128 1,462 0 15 May 2014