Pruning by Active Attention Manipulation

20 October 2022

Z. Babaiee

Lucas Liebenwein

Ramin Hasani

Daniela Rus

Radu Grosu

ArXiv (abs)PDF HTML

Papers citing "Pruning by Active Attention Manipulation"

33 / 33 papers shown

Title
Equal Bits: Enforcing Equally Distributed Binary Network Weights Yun-qiang Li S. Pintea Jan van Gemert MQ 75 15 0 02 Dec 2021
Attention Mechanisms in Computer Vision: A Survey Meng-Hao Guo Tianhan Xu Jiangjiang Liu Zheng-Ning Liu Peng-Tao Jiang Tai-Jiang Mu Song-Hai Zhang Ralph Robert Martin Ming-Ming Cheng Shimin Hu 119 1,707 0 15 Nov 2021
CHIP: CHannel Independence-based Pruning for Compact Neural Networks Yang Sui Miao Yin Yi Xie Huy Phan S. Zonouz Bo Yuan VLM 122 134 0 26 Oct 2021
Sparse Flows: Pruning Continuous-depth Models Lucas Liebenwein Ramin Hasani Alexander Amini Daniela Rus 87 17 0 24 Jun 2021
AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural Networks Alexandra Peste Eugenia Iofinova Adrian Vladu Dan Alistarh AI4CE 405 72 0 23 Jun 2021
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks Torsten Hoefler Dan Alistarh Tal Ben-Nun Nikoli Dryden Alexandra Peste MQ 321 728 0 31 Jan 2021
SCOP: Scientific Control for Reliable Neural Network Pruning Yehui Tang Yunhe Wang Yixing Xu Dacheng Tao Chunjing Xu Chao Xu Chang Xu AAML 112 166 0 21 Oct 2020
Neural Architecture Search without Training J. Mellor Jack Turner Amos Storkey Elliot J. Crowley 65 384 0 08 Jun 2020
HRank: Filter Pruning using High-Rank Feature Map Mingbao Lin Rongrong Ji Yan Wang Yichen Zhang Baochang Zhang Yonghong Tian Ling Shao 88 728 0 24 Feb 2020
Provable Filter Pruning for Efficient Neural Networks Lucas Liebenwein Cenk Baykal Harry Lang Dan Feldman Daniela Rus VLM 3DPC 83 141 0 18 Nov 2019
Learning Filter Basis for Convolutional Neural Network Compression Yawei Li Shuhang Gu Luc Van Gool Radu Timofte SupR 67 99 0 23 Aug 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 172 18,224 0 28 May 2019
Towards Optimal Structured CNN Pruning via Generative Adversarial Learning Shaohui Lin Rongrong Ji Chenqian Yan Baochang Zhang Liujuan Cao QiXiang Ye Feiyue Huang David Doermann CVBM 56 510 0 22 Mar 2019
Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration Yang He Ping Liu Ziwei Wang Zhilan Hu Yi Yang AAML 3DPC 98 1,050 0 01 Nov 2018
Discrimination-aware Channel Pruning for Deep Neural Networks Zhuangwei Zhuang Mingkui Tan Bohan Zhuang Jing Liu Yong Guo Qingyao Wu Junzhou Huang Jin-Hui Zhu 134 601 0 28 Oct 2018
Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks Yang He Guoliang Kang Xuanyi Dong Yanwei Fu Yi Yang AAML VLM 74 965 0 21 Aug 2018
AutoPruner: An End-to-End Trainable Filter Pruning Method for Efficient Deep Model Inference Jian-Hao Luo Jianxin Wu 53 210 0 23 May 2018
AMC: AutoML for Model Compression and Acceleration on Mobile Devices Yihui He Ji Lin Zhijian Liu Hanrui Wang Li Li Song Han 111 1,349 0 10 Feb 2018
Learning Sparse Neural Networks through $L_0$ Regularization Christos Louizos Max Welling Diederik P. Kingma 439 1,148 0 04 Dec 2017
NISP: Pruning Networks using Neuron Importance Score Propagation Ruichi Yu Ang Li Chun-Fu Chen Jui-Hsin Lai Vlad I. Morariu Xintong Han M. Gao Ching-Yung Lin L. Davis 74 800 0 16 Nov 2017
Residual Connections Encourage Iterative Inference Stanislaw Jastrzebski Devansh Arpit Nicolas Ballas Vikas Verma Tong Che Yoshua Bengio 74 155 0 13 Oct 2017
To prune, or not to prune: exploring the efficacy of pruning for model compression Michael Zhu Suyog Gupta 202 1,282 0 05 Oct 2017
Squeeze-and-Excitation Networks Jie Hu Li Shen Samuel Albanie Gang Sun Enhua Wu 427 26,605 0 05 Sep 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 811 132,725 0 12 Jun 2017
Highway and Residual Networks learn Unrolled Iterative Estimation Klaus Greff R. Srivastava Jürgen Schmidhuber AI4TS 116 216 0 22 Dec 2016
Pruning Filters for Efficient ConvNets Hao Li Asim Kadav Igor Durdanovic H. Samet H. Graf 3DPC 195 3,707 0 31 Aug 2016
Learning Structured Sparsity in Deep Neural Networks W. Wen Chunpeng Wu Yandan Wang Yiran Chen Hai Helen Li 199 2,341 0 12 Aug 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 354 10,204 0 16 Mar 2016
Structured Pruning of Deep Convolutional Neural Networks S. Anwar Kyuyeon Hwang Wonyong Sung 134 748 0 29 Dec 2015
Sparsifying Neural Network Connections for Face Recognition Yi Sun Xiaogang Wang Xiaoou Tang 3DH CVBM 64 141 0 07 Dec 2015
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding Song Han Huizi Mao W. Dally 3DGS 263 8,864 0 01 Oct 2015
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 584 27,345 0 01 Sep 2014
Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation Yoshua Bengio Nicholas Léonard Aaron Courville 401 3,158 0 15 Aug 2013