v1v2 (latest)

Compression-aware Training of Deep Networks

7 November 2017

Papers citing "Compression-aware Training of Deep Networks"

50 / 53 papers shown

Title
RocketStack: A level-aware deep recursive ensemble learning framework with exploratory feature fusion and model pruning dynamics Çağatay Demirel 10 0 0 20 Jun 2025
EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation Shih-yang Liu Huck Yang Nai Chit Fung Charbel Sakr Hongxu Yin ... Jan Kautz Yu-Chun Wang Pavlo Molchanov Min-Hung Chen Min-Hung Chen MQ 130 0 0 28 Oct 2024
Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching: With Insights into Other Permutation Search Methods Akira Ito Masanori Yamada Atsutoshi Kumagai MoMe 172 6 0 06 Feb 2024
Hyperspherical Quantization: Toward Smaller and More Accurate Models Dan Liu X. Chen Chen Ma Xue Liu MQ 73 3 0 24 Dec 2022
Pruning On-the-Fly: A Recoverable Pruning Method without Fine-tuning Danyang Liu Xue Liu 72 0 0 24 Dec 2022
Pushing the Efficiency Limit Using Structured Sparse Convolutions Vinay Kumar Verma Nikhil Mehta Shijing Si Ricardo Henao Lawrence Carin 50 3 0 23 Oct 2022
Green Learning: Introduction, Examples and Outlook C.-C. Jay Kuo A. Madni 141 73 0 03 Oct 2022
Compact Model Training by Low-Rank Projection with Energy Transfer K. Guo Zhenquan Lin Xiaofen Xing Fang Liu Xiangmin Xu 81 2 0 12 Apr 2022
Implicit Regularization Towards Rank Minimization in ReLU Networks Nadav Timor Gal Vardi Ohad Shamir 95 51 0 30 Jan 2022
Pruning-aware Sparse Regularization for Network Pruning Nanfei Jiang Xu Zhao Chaoyang Zhao Yongqi An Ming Tang Jinqiao Wang 3DPC 74 13 0 18 Jan 2022
A Highly Effective Low-Rank Compression of Deep Neural Networks with Modified Beam-Search and Modified Stable Rank Moonjung Eo Suhyun Kang Wonjong Rhee 71 1 0 30 Nov 2021
Mining the Weights Knowledge for Optimizing Neural Network Structures Mengqiao Han Xiabi Liu Zhaoyang Hai Xin Duan 27 1 0 11 Oct 2021
Convolutional Neural Network Compression through Generalized Kronecker Product Decomposition Marawan Gamal Abdel Hameed Marzieh S. Tahaei A. Mosleh V. Nia 90 26 0 29 Sep 2021
Distilling Image Classifiers in Object Detectors Shuxuan Guo J. Álvarez Mathieu Salzmann VLM 59 8 0 09 Jun 2021
ChipNet: Budget-Aware Pruning with Heaviside Continuous Approximations Rishabh Tiwari Udbhav Bamba Arnav Chavan D. K. Gupta 69 31 0 14 Feb 2021
Any-Width Networks Thanh Tien Vu Marc Eder True Price Jan-Michael Frahm 71 8 0 06 Dec 2020
FRILL: A Non-Semantic Speech Embedding for Mobile Devices J. Peplinski Joel Shor Sachin P. Joglekar Jake Garrison Shwetak N. Patel 68 24 0 09 Nov 2020
Mixed-Precision Embedding Using a Cache J. Yang Jianyu Huang Jongsoo Park P. T. P. Tang Andrew Tulloch 120 37 0 21 Oct 2020
HALO: Learning to Prune Neural Networks with Shrinkage Skyler Seto M. Wells Wenyu Zhang 71 0 0 24 Aug 2020
Training Sparse Neural Networks using Compressed Sensing Jonathan W. Siegel Jianhong Chen Pengchuan Zhang Jinchao Xu 82 5 0 21 Aug 2020
Enabling On-Device CNN Training by Self-Supervised Instance Filtering and Error Map Pruning Yawen Wu Zhepeng Wang Yiyu Shi Jiaxi Hu 74 46 0 07 Jul 2020
Dynamic Model Pruning with Feedback Tao R. Lin Sebastian U. Stich Luis Barba Daniil Dmitriev Martin Jaggi 175 204 0 12 Jun 2020
Training with Multi-Layer Embeddings for Model Reduction Benjamin Ghaemmaghami Zihao Deng B. Cho Leo Orshansky A. Singh M. Erez Michael Orshansky 3DV 54 10 0 10 Jun 2020
TRP: Trained Rank Pruning for Efficient Deep Neural Networks Yuhui Xu Yuxi Li Shuai Zhang W. Wen Botao Wang Y. Qi Yiran Chen Weiyao Lin H. Xiong AAML 78 71 0 30 Apr 2020
FlexSA: Flexible Systolic Array Architecture for Efficient Pruned DNN Model Training Sangkug Lym M. Erez 36 26 0 27 Apr 2020
Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsification Huanrui Yang Minxue Tang W. Wen Feng Yan Daniel Hu Ang Li H. Li Yiran Chen 66 65 0 20 Apr 2020
GeneCAI: Genetic Evolution for Acquiring Compact AI Mojan Javaheripi Mohammad Samragh T. Javidi F. Koushanfar 74 9 0 08 Apr 2020
Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression Yawei Li Shuhang Gu Christoph Mayer Luc Van Gool Radu Timofte 225 192 0 19 Mar 2020
Exploring the Connection Between Binary and Spiking Neural Networks Sen Lu Abhronil Sengupta MQ 89 103 0 24 Feb 2020
Sparse Weight Activation Training Md Aamir Raihan Tor M. Aamodt 155 73 0 07 Jan 2020
Provable Filter Pruning for Efficient Neural Networks Lucas Liebenwein Cenk Baykal Harry Lang Dan Feldman Daniela Rus VLM 3DPC 102 141 0 18 Nov 2019
Decomposable-Net: Scalable Low-Rank Compression for Neural Networks A. Yaguchi Taiji Suzuki Shuhei Nitta Y. Sakata A. Tanizawa 88 9 0 29 Oct 2019
SiPPing Neural Networks: Sensitivity-informed Provable Pruning of Neural Networks Cenk Baykal Lucas Liebenwein Igor Gilitschenski Dan Feldman Daniela Rus 92 18 0 11 Oct 2019
Global Sparse Momentum SGD for Pruning Very Deep Neural Networks Xiaohan Ding Guiguang Ding Xiangxin Zhou Yuchen Guo Jungong Han Ji Liu 131 165 0 27 Sep 2019
Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems Antonio A. Ginart Maxim Naumov Dheevatsa Mudigere Jiyan Yang James Zou 114 101 0 25 Sep 2019
VACL: Variance-Aware Cross-Layer Regularization for Pruning Deep Residual Networks Shuang Gao Xin Liu Lung-Sheng Chien William Zhang J. Álvarez VLM 3DPC 63 15 0 10 Sep 2019
Bringing Giant Neural Networks Down to Earth with Unlabeled Data Yehui Tang Shan You Chang Xu Boxin Shi Chao Xu 85 11 0 13 Jul 2019
Constructing Energy-efficient Mixed-precision Neural Networks through Principal Component Analysis for Edge Intelligence I. Chakraborty Deboleena Roy Isha Garg Aayush Ankit Kaushik Roy 61 39 0 04 Jun 2019
Bayesian Tensorized Neural Networks with Automatic Rank Selection Cole Hawkins Zheng Zhang BDL 63 54 0 24 May 2019
ASAP: Architecture Search, Anneal and Prune Asaf Noy Niv Nayman T. Ridnik Nadav Zamir Sivan Doveh Itamar Friedman Raja Giryes Lihi Zelnik-Manor 84 103 0 08 Apr 2019
Centripetal SGD for Pruning Very Deep Convolutional Networks with Complicated Structure Xiaohan Ding Guiguang Ding Yuchen Guo Jiawei Han 3DPC 77 185 0 08 Apr 2019
Efficient Hybrid Network Architectures for Extremely Quantized Neural Networks Enabling Intelligence at the Edge I. Chakraborty Deboleena Roy Aayush Ankit Kaushik Roy GNN MQ 56 14 0 01 Feb 2019
PruneTrain: Fast Neural Network Training by Dynamic Sparse Model Reconfiguration Sangkug Lym Esha Choukse Siavash Zangeneh W. Wen Sujay Sanghavi M. Erez CVBM 83 88 0 26 Jan 2019
A Low Effort Approach to Structured CNN Design Using PCA Isha Garg Priyadarshini Panda Kaushik Roy 68 62 0 15 Dec 2018
Trained Rank Pruning for Efficient Deep Neural Networks Yuhui Xu Yuxi Li Shuai Zhang W. Wen Botao Wang Y. Qi Yiran Chen Weiyao Lin H. Xiong AAML 108 42 0 06 Dec 2018
On Compressing U-net Using Knowledge Distillation K. Mangalam Mathieu Salzamann AI4CE 62 17 0 01 Dec 2018
Dynamic Sparse Graph for Efficient Deep Learning Liu Liu Lei Deng Xing Hu Maohua Zhu Guoqi Li Yufei Ding Yuan Xie GNN 90 42 0 01 Oct 2018
Extreme Network Compression via Filter Group Approximation Bo Peng Wenming Tan Zheyang Li Shun Zhang Di Xie Shiliang Pu 90 63 0 30 Jul 2018
Coreset-Based Neural Network Compression Abhimanyu Dubey Moitreya Chatterjee Narendra Ahuja 66 81 0 25 Jul 2018
Filter Distillation for Network Compression Xavier Suau Luca Zappella N. Apostoloff 46 38 0 20 Jul 2018