Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep Architectures

12 July 2016

Papers citing "Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep Architectures"

50 / 131 papers shown

Title
Exploiting Unstructured Sparsity in Fully Homomorphic Encrypted DNNs Aidan Ferguson Perry Gibson Lara DÁgata Parker McLeod Ferhat Yaman Amitabh Das Ian Colbert José Cano 63 0 0 12 Mar 2025
Forget the Data and Fine-Tuning! Just Fold the Network to Compress Dong Wang Haris Šikić Lothar Thiele O. Saukh 68 0 0 17 Feb 2025
Information Consistent Pruning: How to Efficiently Search for Sparse Networks? Soheil Gharatappeh Salimeh Yasaei Sekeh 59 0 0 28 Jan 2025
Efficient Partitioning Vision Transformer on Edge Devices for Distributed Inference Xiang Liu Yijun Song Xia Li Yifei Sun Huiying Lan Zemin Liu Linshan Jiang Jialin Li 21 1 0 15 Oct 2024
Q-VLM: Post-training Quantization for Large Vision-Language Models Changyuan Wang Ziwei Wang Xiuwei Xu Yansong Tang Jie Zhou Jiwen Lu MQ 32 2 0 10 Oct 2024
The Unreasonable Ineffectiveness of the Deeper Layers Andrey Gromov Kushal Tirumala Hassan Shapourian Paolo Glorioso Daniel A. Roberts 54 84 0 26 Mar 2024
Knowledge Translation: A New Pathway for Model Compression Wujie Sun Defang Chen Jiawei Chen Yan Feng Chun-Yen Chen Can Wang 31 0 0 11 Jan 2024
Deeper Understanding of Black-box Predictions via Generalized Influence Functions Hyeonsu Lyu Jonggyu Jang Sehyun Ryu H. Yang TDI AI4CE 27 5 0 09 Dec 2023
REDS: Resource-Efficient Deep Subnetworks for Dynamic Resource Constraints Francesco Corti Balz Maag Joachim Schauer U. Pferschy O. Saukh 46 2 0 22 Nov 2023
Using Cooperative Game Theory to Prune Neural Networks M. Diaz-Ortiz Benjamin Kempinski Daphne Cornelisse Yoram Bachrach Tal Kachman 46 2 0 17 Nov 2023
Adaptive Compression-Aware Split Learning and Inference for Enhanced Network Efficiency Akrit Mudvari Antero Vainio Iason Ofeidis Sasu Tarkoma Leandros Tassiulas 32 3 0 09 Nov 2023
Filter Pruning For CNN With Enhanced Linear Representation Redundancy Bojue Wang Chun-Xia Ma Bin Liu Nianbo Liu Jinqi Zhu 42 1 0 10 Oct 2023
Maestro: Uncovering Low-Rank Structures via Trainable Decomposition Samuel Horváth Stefanos Laskaridis Shashank Rajput Hongyi Wang BDL 37 4 0 28 Aug 2023
Understanding Activation Patterns in Artificial Neural Networks by Exploring Stochastic Processes S. Lehmler Muhammad Saif-ur-Rehman Tobias Glasmachers Ioannis Iossifidis 27 0 0 01 Aug 2023
Approximate Computing Survey, Part II: Application-Specific & Architectural Approximation Techniques and Applications Vasileios Leon Muhammad Abdullah Hanif Giorgos Armeniakos Xun Jiao Mohamed Bennai K. Pekmestzi Dimitrios Soudris 42 3 0 20 Jul 2023
Minimizing Energy Consumption of Deep Learning Models by Energy-Aware Training Dario Lazzaro Antonio Emanuele Cinà Maura Pintor Ambra Demontis Battista Biggio Fabio Roli Marcello Pelillo 40 7 0 01 Jul 2023
Filter Pruning for Efficient CNNs via Knowledge-driven Differential Filter Sampler Shaohui Lin Wenxuan Huang Jiao Xie Baochang Zhang Yunhang Shen Zhou Yu Jungong Han David Doermann 25 2 0 01 Jul 2023
A Simple and Effective Pruning Approach for Large Language Models Mingjie Sun Zhuang Liu Anna Bair J. Zico Kolter 87 361 0 20 Jun 2023
Cuttlefish: Low-Rank Model Training without All the Tuning Hongyi Wang Saurabh Agarwal Pongsakorn U-chupala Yoshiki Tanaka Eric P. Xing Dimitris Papailiopoulos OffRL 63 22 0 04 May 2023
Performance-aware Approximation of Global Channel Pruning for Multitask CNNs Hancheng Ye Bo Zhang Tao Chen Jiayuan Fan Bin Wang 32 18 0 21 Mar 2023
Pruning Deep Neural Networks from a Sparsity Perspective Enmao Diao G. Wang Jiawei Zhan Yuhong Yang Jie Ding Vahid Tarokh 27 30 0 11 Feb 2023
Hyperspherical Quantization: Toward Smaller and More Accurate Models Dan Liu X. Chen Chen Ma Xue Liu MQ 32 3 0 24 Dec 2022
Pruning On-the-Fly: A Recoverable Pruning Method without Fine-tuning Danyang Liu Xue Liu 28 0 0 24 Dec 2022
Cooperative data-driven modeling Aleksandr Dekhovich O. T. Turan Jiaxiang Yi Miguel A. Bessa CLL KELM AI4CE 19 5 0 23 Nov 2022
Embedding Compression for Text Classification Using Dictionary Screening Jing Zhou Xinru Jing Mu Liu Hansheng Wang 29 0 0 23 Nov 2022
Yield Evaluation of Citrus Fruits based on the YoloV5 compressed by Knowledge Distillation Yuqi Li Yuting He Yihang Zhou Zirui Gong Ren-Jun Huang 21 0 0 16 Nov 2022
Pruning Very Deep Neural Network Channels for Efficient Inference Yihui He 35 1 0 14 Nov 2022
Neural Networks Reduction via Lumping Dalila Ressi Riccardo Romanello S. Rossi Carla Piazza 38 4 0 15 Sep 2022
Seeking Interpretability and Explainability in Binary Activated Neural Networks Benjamin Leblanc Pascal Germain FAtt 42 1 0 07 Sep 2022
Survey: Exploiting Data Redundancy for Optimization of Deep Learning Jou-An Chen Wei Niu Bin Ren Yanzhi Wang Xipeng Shen 23 24 0 29 Aug 2022
Continual Prune-and-Select: Class-incremental learning with specialized subnetworks Aleksandr Dekhovich David Tax M. Sluiter Miguel A. Bessa CLL 26 20 0 09 Aug 2022
SBPF: Sensitiveness Based Pruning Framework For Convolutional Neural Network On Image Classification Yihe Lu Maoguo Gong Wei Zhao Kaiyuan Feng Hao Li VLM 29 0 0 09 Aug 2022
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks Tilman Raukur A. Ho Stephen Casper Dylan Hadfield-Menell AAML AI4CE 28 125 0 27 Jul 2022
Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesis Long Zhuo Guangcong Wang Shikai Li Wayne Wu Ziwei Liu VGen 53 20 0 11 Jul 2022
E^2TAD: An Energy-Efficient Tracking-based Action Detector Xin Hu Zhenyu Wu Haoyuan Miao Siqi Fan Taiyu Long ... Pengcheng Pi Yi Wu Zhou Ren Zhangyang Wang G. Hua 24 2 0 09 Apr 2022
Deep neural network goes lighter: A case study of deep compression techniques on automatic RF modulation recognition for Beyond 5G networks Anu Jagannath Jithin Jagannath Yanzhi Wang Tommaso Melodia 31 3 0 09 Apr 2022
HRel: Filter Pruning based on High Relevance between Activation Maps and Class Labels C. Sarvani Mrinmoy Ghorai S. Dubey S. H. Shabbeer Basha VLM 39 37 0 22 Feb 2022
Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters Mingbao Lin Liujuan Cao Yuxin Zhang Ling Shao Chia-Wen Lin Rongrong Ji 35 51 0 15 Feb 2022
Recursive Least Squares for Training and Pruning Convolutional Neural Networks Tianzong Yu Chunyuan Zhang Yuan Wang Meng-tao Ma Qingwei Song 35 1 0 13 Jan 2022
An Experimental Study of the Impact of Pre-training on the Pruning of a Convolutional Neural Network Nathan Hubens M. Mancas B. Gosselin Marius Preda T. Zaharia VLM CVBM 23 8 0 15 Dec 2021
Batch Normalization Tells You Which Filter is Important Junghun Oh Heewon Kim Sungyong Baik Chee Hong Kyoung Mu Lee CVBM 44 8 0 02 Dec 2021
Automatic Neural Network Pruning that Efficiently Preserves the Model Accuracy Thibault Castells Seul-Ki Yeom 3DV 20 3 0 18 Nov 2021
RMNet: Equivalently Removing Residual Connection from Networks Fanxu Meng Hao Cheng Jia-Xin Zhuang Ke Li Xing Sun 31 11 0 01 Nov 2021
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge Geng Yuan Xiaolong Ma Wei Niu Zhengang Li Zhenglun Kong ... Minghai Qin Bin Ren Yanzhi Wang Sijia Liu Xue Lin 28 89 0 26 Oct 2021
Reconstructing Pruned Filters using Cheap Spatial Transformations Roy Miles K. Mikolajczyk 29 0 0 25 Oct 2021
HALP: Hardware-Aware Latency Pruning Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez VLM 46 13 0 20 Oct 2021
S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks Shiyu Liu Chong Min John Tan Mehul Motani CLL 29 4 0 17 Oct 2021
Training Deep Neural Networks with Joint Quantization and Pruning of Weights and Activations Xinyu Zhang Ian Colbert Ken Kreutz-Delgado Srinjoy Das MQ 34 11 0 15 Oct 2021
Joint Channel and Weight Pruning for Model Acceleration on Moblie Devices Tianli Zhao Xi Sheryl Zhang Wentao Zhu Jiaxing Wang Sen Yang Ji Liu Jian Cheng 56 2 0 15 Oct 2021
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks Shuai Zhang Meng Wang Sijia Liu Pin-Yu Chen Jinjun Xiong UQCV MLT 31 13 0 12 Oct 2021