Learning both Weights and Connections for Efficient Neural Networks

8 June 2015

Song Han

Papers citing "Learning both Weights and Connections for Efficient Neural Networks"

50 / 1,144 papers shown

Title
The Unreasonable Ineffectiveness of the Deeper Layers Andrey Gromov Kushal Tirumala Hassan Shapourian Paolo Glorioso Daniel A. Roberts 59 84 0 26 Mar 2024
EAS-SNN: End-to-End Adaptive Sampling and Representation for Event-based Detection with Recurrent Spiking Neural Networks Ziming Wang Ziling Wang Huaning Li Lang Qin Runhao Jiang De Ma Huajin Tang 44 11 0 19 Mar 2024
Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection Martin Aubard László Antal Ana Madureira Erika Ábrahám 24 7 0 14 Mar 2024
A Teacher-Free Graph Knowledge Distillation Framework with Dual Self-Distillation Lirong Wu Haitao Lin Zhangyang Gao Guojiang Zhao Stan Z. Li 45 8 0 06 Mar 2024
Towards Explaining Deep Neural Network Compression Through a Probabilistic Latent Space Mahsa Mozafari-Nia Salimeh Yasaei Sekeh 33 0 0 29 Feb 2024
SequentialAttention++ for Block Sparsification: Differentiable Pruning Meets Combinatorial Optimization T. Yasuda Kyriakos Axiotis Gang Fu M. Bateni Vahab Mirrokni 49 0 0 27 Feb 2024
Towards Meta-Pruning via Optimal Transport Alexander Theus Olin Geimer Friedrich Wicke Thomas Hofmann Sotiris Anagnostidis Sidak Pal Singh MoMe 26 3 0 12 Feb 2024
DE $^3$ -BERT: Distance-Enhanced Early Exiting for BERT based on Prototypical Networks Jianing He Qi Zhang Weiping Ding Duoqian Miao Jun Zhao Liang Hu LongBing Cao 40 3 0 03 Feb 2024
Speeding up and reducing memory usage for scientific machine learning via mixed precision Joel Hayford Jacob Goldman-Wetzler Eric Wang Lu Lu 54 8 0 30 Jan 2024
Stochastic Subnetwork Annealing: A Regularization Technique for Fine Tuning Pruned Subnetworks Tim Whitaker Darrell Whitley 40 0 0 16 Jan 2024
GD doesn't make the cut: Three ways that non-differentiability affects neural network training Siddharth Krishna Kumar AAML 31 2 0 16 Jan 2024
Always-Sparse Training by Growing Connections with Guided Stochastic Exploration Mike Heddes Narayan Srinivasa T. Givargis Alexandru Nicolau 91 0 0 12 Jan 2024
Knowledge Translation: A New Pathway for Model Compression Wujie Sun Defang Chen Jiawei Chen Yan Feng Chun-Yen Chen Can Wang 33 0 0 11 Jan 2024
Astrocyte Regulated Neuromorphic Central Pattern Generator Control of Legged Robotic Locomotion Zhuangyu Han Abhronil Sengupta 35 2 0 25 Dec 2023
PERP: Rethinking the Prune-Retrain Paradigm in the Era of LLMs Max Zimmer Megi Andoni Christoph Spiegel Sebastian Pokutta VLM 57 10 0 23 Dec 2023
Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AI Kai Huang Wei Gao 32 35 0 21 Dec 2023
ARBiBench: Benchmarking Adversarial Robustness of Binarized Neural Networks Peng Zhao Jiehua Zhang Bowen Peng Longguang Wang Yingmei Wei Yu Liu Li Liu AAML 42 0 0 21 Dec 2023
The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction Pratyusha Sharma Jordan T. Ash Dipendra Kumar Misra LRM 19 80 0 21 Dec 2023
SCoTTi: Save Computation at Training Time with an adaptive framework Ziyu Li Enzo Tartaglione Van-Tam Nguyen 44 0 0 19 Dec 2023
Fluctuation-based Adaptive Structured Pruning for Large Language Models Yongqi An Xu Zhao Tao Yu Ming Tang Jinqiao Wang 42 42 0 19 Dec 2023
Optimizing Dense Feed-Forward Neural Networks Luis Balderas Miguel Lastra José M. Benítez 26 5 0 16 Dec 2023
Gradient-based Parameter Selection for Efficient Fine-Tuning Zhi Zhang Qizhe Zhang Zijun Gao Renrui Zhang Ekaterina Shutova Shiji Zhou Shanghang Zhang 38 15 0 15 Dec 2023
MaxQ: Multi-Axis Query for N:M Sparsity Network Jingyang Xiang Siqi Li Junhao Chen Zhuangzhi Chen Tianxin Huang Linpeng Peng Yong-Jin Liu 18 0 0 12 Dec 2023
Accelerating Convolutional Neural Network Pruning via Spatial Aura Entropy Bogdan Musat Razvan Andonie 26 0 0 08 Dec 2023
Towards Sobolev Pruning Neil Kichler Sher Afghan U. Naumann 23 0 0 06 Dec 2023
Subnetwork-to-go: Elastic Neural Network with Dynamic Training and Customizable Inference Kai Li Yi Luo 39 2 0 06 Dec 2023
Initializing Models with Larger Ones Zhiqiu Xu Yanjie Chen Kirill Vishniakov Yida Yin Zhiqiang Shen Trevor Darrell Lingjie Liu Zhuang Liu 48 17 0 30 Nov 2023
Efficient Stitchable Task Adaptation Haoyu He Zizheng Pan Jing Liu Jianfei Cai Bohan Zhuang 39 3 0 29 Nov 2023
TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models Yushi Huang Ruihao Gong Jing Liu Tianlong Chen Xianglong Liu DiffM MQ 35 38 0 27 Nov 2023
REDS: Resource-Efficient Deep Subnetworks for Dynamic Resource Constraints Francesco Corti Balz Maag Joachim Schauer U. Pferschy O. Saukh 54 2 0 22 Nov 2023
Investigating Weight-Perturbed Deep Neural Networks With Application in Iris Presentation Attack Detection Renu Sharma Redwan Sony Arun Ross AAML 21 3 0 21 Nov 2023
Using Cooperative Game Theory to Prune Neural Networks M. Diaz-Ortiz Benjamin Kempinski Daphne Cornelisse Yoram Bachrach Tal Kachman 46 2 0 17 Nov 2023
RepQ: Generalizing Quantization-Aware Training for Re-Parametrized Architectures Anastasiia Prutianova Alexey Zaytsev Chung-Kuei Lee Fengyu Sun Ivan Koryakovskiy MQ 28 0 0 09 Nov 2023
The Road to On-board Change Detection: A Lightweight Patch-Level Change Detection Network via Exploring the Potential of Pruning and Pooling Lihui Xue Zhihao Wang Xueqian Wang Gang Li 50 1 0 16 Oct 2023
Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs Yuxin Zhang Lirui Zhao Mingbao Lin Yunyun Sun Yiwu Yao Xingjia Han Jared Tanner Shiwei Liu Rongrong Ji SyDa 45 40 0 13 Oct 2023
On sparse regression, Lp-regularization, and automated model discovery Jeremy A. McCulloch Skyler R. St. Pierre K. Linka E. Kuhl 32 29 0 09 Oct 2023
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity Lu Yin You Wu Zhenyu Zhang Cheng-Yu Hsieh Yaqing Wang ... Mykola Pechenizkiy Yi Liang Michael Bendersky Zhangyang Wang Shiwei Liu 41 80 0 08 Oct 2023
Network Memory Footprint Compression Through Jointly Learnable Codebooks and Mappings Vittorio Giammarino Arnaud Dapogny Kévin Bailly MQ 29 1 0 29 Sep 2023
SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels Henry Hengyuan Zhao Pichao Wang Yuyang Zhao Hao Luo F. Wang Mike Zheng Shou ViT 42 14 0 15 Sep 2023
Adaptive Model Pruning and Personalization for Federated Learning over Wireless Networks Xiaonan Liu T. Ratnarajah M. Sellathurai Yonina C. Eldar 42 4 0 04 Sep 2023
Uncovering the Hidden Cost of Model Compression Diganta Misra Muawiz Chaudhary Agam Goyal Bharat Runwal Pin-Yu Chen VLM 40 0 0 29 Aug 2023
Eventful Transformers: Leveraging Temporal Redundancy in Vision Transformers Matthew Dutson Yin Li M. Gupta ViT 45 8 0 25 Aug 2023
Benchmarking Adversarial Robustness of Compressed Deep Learning Models Brijesh Vora Kartik Patwari Syed Mahbub Hafiz Zubair Shafiq Chen-Nee Chuah AAML 32 2 0 16 Aug 2023
Ada-QPacknet -- adaptive pruning with bit width reduction as an efficient continual learning method without forgetting Marcin Pietroñ Dominik Zurek Kamil Faber Roberto Corizzo CLL 37 2 0 14 Aug 2023
Neural Networks at a Fraction with Pruned Quaternions Sahel Mohammad Iqbal Subhankar Mishra 35 4 0 13 Aug 2023
Resource Constrained Model Compression via Minimax Optimization for Spiking Neural Networks Jue Chen Huan Yuan Jianchao Tan Bin Chen Chengru Song Di Zhang 30 3 0 09 Aug 2023
D-Score: A Synapse-Inspired Approach for Filter Pruning Doyoung Park Jinsoo Kim Ji-Min Nam Jooyoung Chang S. Park 22 0 0 08 Aug 2023
Accurate Retraining-free Pruning for Pretrained Encoder-based Language Models Seungcheol Park Ho-Jin Choi U. Kang VLM 49 5 0 07 Aug 2023
Pruning a neural network using Bayesian inference Sunil Mathew D. Rowe 16 0 0 04 Aug 2023
Discriminative Feature Attributions: Bridging Post Hoc Explainability and Inherent Interpretability Usha Bhalla Suraj Srinivas Himabindu Lakkaraju FAtt CML 44 6 0 27 Jul 2023