Structured Pruning of Deep Convolutional Neural Networks

29 December 2015

Papers citing "Structured Pruning of Deep Convolutional Neural Networks"

50 / 92 papers shown

Title
Optimizing LLMs for Resource-Constrained Environments: A Survey of Model Compression Techniques Sanjay Surendranath Girija Shashank Kapoor Lakshit Arora Dipen Pradhan Aman Raj Ankit Shetgaonkar 57 0 0 05 May 2025
B-FPGM: Lightweight Face Detection via Bayesian-Optimized Soft FPGM Pruning Nikolaos Kaparinos Vasileios Mezaris CVBM 55 0 0 28 Jan 2025
Engineering Carbon Credits Towards A Responsible FinTech Era: The Practices, Implications, and Future Qingwen Zeng Hanlin Xu Nanjun Xu Flora Salim Junbin Gao Huaming Chen 34 0 0 28 Jan 2025
S3D: A Simple and Cost-Effective Self-Speculative Decoding Scheme for Low-Memory GPUs Wei Zhong Manasa Bharadwaj 47 5 0 30 May 2024
NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models Amit Dhurandhar Tejaswini Pedapati Ronny Luss Soham Dan Aurélie C. Lozano Payel Das Georgios Kollias 22 3 0 28 Feb 2024
SequentialAttention++ for Block Sparsification: Differentiable Pruning Meets Combinatorial Optimization T. Yasuda Kyriakos Axiotis Gang Fu M. Bateni Vahab Mirrokni 44 0 0 27 Feb 2024
Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes Lucio Dery Steven Kolawole Jean-Francois Kagey Virginia Smith Graham Neubig Ameet Talwalkar 44 28 0 08 Feb 2024
Fluctuation-based Adaptive Structured Pruning for Large Language Models Yongqi An Xu Zhao Tao Yu Ming Tang Jinqiao Wang 36 42 0 19 Dec 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets A. D. Cunha Francesco d’Amore Emanuele Natale MLT 27 1 0 16 Nov 2023
Understanding Activation Patterns in Artificial Neural Networks by Exploring Stochastic Processes S. Lehmler Muhammad Saif-ur-Rehman Tobias Glasmachers Ioannis Iossifidis 27 0 0 01 Aug 2023
Seeing is Believing: Brain-Inspired Modular Training for Mechanistic Interpretability Ziming Liu Eric Gan Max Tegmark 26 36 0 04 May 2023
The Disharmony between BN and ReLU Causes Gradient Explosion, but is Offset by the Correlation between Activations Inyoung Paik Jaesik Choi 18 0 0 23 Apr 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić E. Ponti MoMe OOD 32 73 0 22 Feb 2023
A Comprehensive Survey of Dataset Distillation Shiye Lei Dacheng Tao DD 31 88 0 13 Jan 2023
GOHSP: A Unified Framework of Graph and Optimization-based Heterogeneous Structured Pruning for Vision Transformer Miao Yin Burak Uzkent Yilin Shen Hongxia Jin Bo Yuan ViT 29 13 0 13 Jan 2023
Pruning Compact ConvNets for Efficient Inference Sayan Ghosh Karthik Prasad Xiaoliang Dai Peizhao Zhang Bichen Wu Graham Cormode Peter Vajda VLM 19 4 0 11 Jan 2023
FSCNN: A Fast Sparse Convolution Neural Network Inference System Bo Ji Tianyi Chen 26 3 0 17 Dec 2022
Finding Skill Neurons in Pre-trained Transformer-based Language Models Xiaozhi Wang Kaiyue Wen Zhengyan Zhang Lei Hou Zhiyuan Liu Juanzi Li MILM MoE 27 50 0 14 Nov 2022
Pruning Very Deep Neural Network Channels for Efficient Inference Yihui He 35 1 0 14 Nov 2022
RepGhost: A Hardware-Efficient Ghost Module via Re-parameterization Chengpeng Chen Zichao Guo Haien Zeng Pengfei Xiong Jian Dong 26 37 0 11 Nov 2022
Efficient and Accurate Quantized Image Super-Resolution on Mobile NPUs, Mobile AI & AIM 2022 challenge: Report Andrey D. Ignatov Radu Timofte Maurizio Denna Abdelbadie Younes Ganzorig Gankhuyag ... Jing Liu Garas Gendy Nabil Sabor J. Hou Guanghui He SupR MQ 23 31 0 07 Nov 2022
Fast and Low-Memory Deep Neural Networks Using Binary Matrix Factorization Alireza Bordbar M. Kahaei MQ 33 0 0 24 Oct 2022
Pruning by Active Attention Manipulation Z. Babaiee Lucas Liebenwein Ramin Hasani Daniela Rus Radu Grosu 22 0 0 20 Oct 2022
Large Language Models are Pretty Good Zero-Shot Video Game Bug Detectors Mohammad Reza Taesiri Finlay Macklon Yihe Wang Hengshuo Shen C. Bezemer ELM LLMAG MLLM 44 13 0 05 Oct 2022
CRISP: Curriculum based Sequential Neural Decoders for Polar Code Family Ashwin Hebbar Viraj Nadkarni Ashok Vardhan Makkuva S. Bhat Sewoong Oh Pramod Viswanath 30 6 0 01 Oct 2022
Sauron U-Net: Simple automated redundancy elimination in medical image segmentation via filter pruning Juan Miguel Valverde Artem Shatillo Jussi Tohka AAML 29 5 0 27 Sep 2022
Building an Efficiency Pipeline: Commutativity and Cumulativeness of Efficiency Operators for Transformers Ji Xin Raphael Tang Zhiying Jiang Yaoliang Yu Jimmy J. Lin 18 1 0 31 Jul 2022
CoNLoCNN: Exploiting Correlation and Non-Uniform Quantization for Energy-Efficient Low-precision Deep Convolutional Neural Networks Muhammad Abdullah Hanif G. M. Sarda Alberto Marchisio Guido Masera Maurizio Martina Muhammad Shafique MQ 22 4 0 31 Jul 2022
DropNet: Reducing Neural Network Complexity via Iterative Pruning Chong Min John Tan Mehul Motani 26 52 0 14 Jul 2022
Revisiting Random Channel Pruning for Neural Network Compression Yawei Li Kamil Adamczewski Wen Li Shuhang Gu Radu Timofte Luc Van Gool 24 81 0 11 May 2022
Triangular Dropout: Variable Network Width without Retraining Edward W. Staley Jared Markowitz 28 2 0 02 May 2022
Multiply-and-Fire (MNF): An Event-driven Sparse Neural Network Accelerator Miao Yu Tingting Xiang Venkata Pavan Kumar Miriyala Trevor E. Carlson 20 1 0 20 Apr 2022
Delta Keyword Transformer: Bringing Transformers to the Edge through Dynamically Pruned Multi-Head Self-Attention Zuzana Jelčicová Marian Verhelst 28 5 0 20 Mar 2022
S-Rocket: Selective Random Convolution Kernels for Time Series Classification Hojjat Salehinejad Yang Wang Yuanhao Yu Jingshan Tang S. Valaee AI4TS 36 15 0 07 Mar 2022
Recursive Least Squares for Training and Pruning Convolutional Neural Networks Tianzong Yu Chunyuan Zhang Yuan Wang Meng-tao Ma Qingwei Song 30 1 0 13 Jan 2022
An Experimental Study of the Impact of Pre-training on the Pruning of a Convolutional Neural Network Nathan Hubens M. Mancas B. Gosselin Marius Preda T. Zaharia VLM CVBM 23 8 0 15 Dec 2021
Self-Compression in Bayesian Neural Networks Giuseppina Carannante Dimah Dera Ghulam Rasool N. Bouaynaya UQCV BDL 33 5 0 10 Nov 2021
Gabor filter incorporated CNN for compression Akihiro Imamura N. Arizumi CVBM 28 2 0 29 Oct 2021
Differentiable Network Pruning for Microcontrollers Edgar Liberis Nicholas D. Lane 22 18 0 15 Oct 2021
Prune Your Model Before Distill It Jinhyuk Park Albert No VLM 46 27 0 30 Sep 2021
Layer-wise Model Pruning based on Mutual Information Chun Fan Jiwei Li Xiang Ao Fei Wu Yuxian Meng Xiaofei Sun 46 19 0 28 Aug 2021
MAFAT: Memory-Aware Fusing and Tiling of Neural Networks for Accelerated Edge Inference J. Farley A. Gerstlauer FedML 28 5 0 14 Jul 2021
Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better Gaurav Menghani VLM MedIm 23 366 0 16 Jun 2021
Quantization and Deployment of Deep Neural Networks on Microcontrollers Pierre-Emmanuel Novac G. B. Hacene Alain Pegatoquet Benoit Miramond Vincent Gripon MQ 20 116 0 27 May 2021
Bag of Baselines for Multi-objective Joint Neural Architecture Search and Hyperparameter Optimization Julia Guerrero-Viu Sven Hauns Sergio Izquierdo Guilherme Miotto Simon Schrodi André Biedenkapp T. Elsken Difan Deng Marius Lindauer Frank Hutter AI4CE 17 25 0 03 May 2021
Environmental Sound Classification on the Edge: A Pipeline for Deep Acoustic Networks on Extremely Resource-Constrained Devices Md Mohaimenuzzaman Christoph Bergmeir I. West B. Meyer 17 41 0 05 Mar 2021
Baseline Pruning-Based Approach to Trojan Detection in Neural Networks P. Bajcsy Michael Majurski AAML 34 8 0 22 Jan 2021
NetCut: Real-Time DNN Inference Using Layer Removal Mehrshad Zandigohar Deniz Erdogmus G. Schirner 17 5 0 13 Jan 2021
Parallel Blockwise Knowledge Distillation for Deep Neural Network Compression Cody Blakeney Xiaomin Li Yan Yan Ziliang Zong 46 39 0 05 Dec 2020
Bringing AI To Edge: From Deep Learning's Perspective Di Liu Hao Kong Xiangzhong Luo Weichen Liu Ravi Subramaniam 52 116 0 25 Nov 2020