The Need for Speed: Pruning Transformers with One Recipe

The Need for Speed: Pruning Transformers with One Recipe

26 March 2024

Konstantinos N. Plataniotis

Papers citing "The Need for Speed: Pruning Transformers with One Recipe"

13 / 13 papers shown

Title
A Sensorimotor Vision Transformer Konrad Gadzicki K. Schill C. Zetzsche 59 0 0 03 Apr 2025
Learning to Inference Adaptively for Multimodal Large Language Models Zhuoyan Xu Khoi Duc Nguyen Preeti Mukherjee Saurabh Bagchi Somali Chaterji Yingyu Liang Yin Li LRM 49 1 0 13 Mar 2025
Accelerate 3D Object Detection Models via Zero-Shot Attention Key Pruning Lizhen Xu Xiuxiu Bai Xiaojun Jia Jianwu Fang Shanmin Pang 63 0 0 13 Mar 2025
Redundant Queries in DETR-Based 3D Detection Methods: Unnecessary and Prunable Lizhen Xu Shanmin Pang Wenzhao Qiu Zehao Wu Xiuxiu Bai K. Mei Jianru Xue 80 1 0 03 Dec 2024
Supervised Fine-Tuning Achieve Rapid Task Adaption Via Alternating Attention Head Activation Patterns Yang Zhao Li Du Xiao Ding Kai Xiong Ting Liu Bing Qin 23 2 0 24 Sep 2024
Greedy Output Approximation: Towards Efficient Structured Pruning for LLMs Without Retraining Jianwei Li Yijun Dong Qi Lei 30 5 0 26 Jul 2024
Large Language Model Pruning Hanjuan Huang Hao-Jia Song H. Pao 46 0 0 24 May 2024
ATOM: Attention Mixer for Efficient Dataset Distillation Samir Khaki A. Sajedi Kai Wang Lucy Z. Liu Y. Lawryshyn Konstantinos N. Plataniotis 50 3 0 02 May 2024
DepGraph: Towards Any Structural Pruning Gongfan Fang Xinyin Ma Mingli Song Michael Bi Mi Xinchao Wang GNN 91 257 0 30 Jan 2023
CONetV2: Efficient Auto-Channel Size Optimization for CNNs Yi Ru Wang Samir Khaki Weihang Zheng Mahdi S. Hosseini Konstantinos N. Plataniotis 31 6 0 13 Oct 2021
I-BERT: Integer-only BERT Quantization Sehoon Kim A. Gholami Z. Yao Michael W. Mahoney Kurt Keutzer MQ 105 341 0 05 Jan 2021
SCOP: Scientific Control for Reliable Neural Network Pruning Yehui Tang Yunhe Wang Yixing Xu Dacheng Tao Chunjing Xu Chao Xu Chang Xu AAML 50 166 0 21 Oct 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,959 0 20 Apr 2018