Learning Structured Sparsity in Deep Neural Networks

12 August 2016

Yiran Chen

Papers citing "Learning Structured Sparsity in Deep Neural Networks"

50 / 331 papers shown

Title
Workload-Balanced Pruning for Sparse Spiking Neural Networks Ruokai Yin Youngeun Kim Yuhang Li Abhishek Moitra Nitin Satpute Anna Hambitzer Priyadarshini Panda 37 19 0 13 Feb 2023
EVC: Towards Real-Time Neural Image Compression with Mask Decay G. Wang Jiahao Li Bin Li Yan Lu 22 63 0 10 Feb 2023
What Matters In The Structured Pruning of Generative Language Models? Michael Santacroce Zixin Wen Yelong Shen Yuan-Fang Li 21 33 0 07 Feb 2023
Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers Sungmin Cha Sungjun Cho Dasol Hwang Honglak Lee Taesup Moon Moontae Lee MU 41 35 0 27 Jan 2023
GOHSP: A Unified Framework of Graph and Optimization-based Heterogeneous Structured Pruning for Vision Transformer Miao Yin Burak Uzkent Yilin Shen Hongxia Jin Bo Yuan ViT 32 13 0 13 Jan 2023
Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning Huan Wang Can Qin Yue Bai Yun Fu 37 20 0 12 Jan 2023
Exploring Optimal Substructure for Out-of-distribution Generalization via Feature-targeted Model Pruning Yingchun Wang Jingcai Guo Song Guo Weizhan Zhang Jiewei Zhang OODD 37 16 0 19 Dec 2022
Statistical guarantees for sparse deep learning Johannes Lederer 19 11 0 11 Dec 2022
Efficient Stein Variational Inference for Reliable Distribution-lossless Network Pruning Yingchun Wang Song Guo Jingcai Guo Weizhan Zhang Yi Tian Xu Jiewei Zhang Yi Liu 21 17 0 07 Dec 2022
Matching DNN Compression and Cooperative Training with Resources and Data Availability F. Malandrino G. Giacomo Armin Karamzade Marco Levorato C. Chiasserini 45 9 0 02 Dec 2022
Pruning Very Deep Neural Network Channels for Efficient Inference Yihui He 35 1 0 14 Nov 2022
MGiaD: Multigrid in all dimensions. Efficiency and robustness by coarsening in resolution and channel dimensions Antonia van Betteray Matthias Rottmann Karsten Kahl 31 2 0 10 Nov 2022
HFedMS: Heterogeneous Federated Learning with Memorable Data Semantics in Industrial Metaverse Shenglai Zeng Zonghang Li Hongfang Yu Zhihao Zhang Long Luo Bo-wen Li Dusit Niyato 37 42 0 07 Nov 2022
Fast and Low-Memory Deep Neural Networks Using Binary Matrix Factorization Alireza Bordbar M. Kahaei MQ 33 0 0 24 Oct 2022
Pruning by Active Attention Manipulation Z. Babaiee Lucas Liebenwein Ramin Hasani Daniela Rus Radu Grosu 22 0 0 20 Oct 2022
Neural Network Compression by Joint Sparsity Promotion and Redundancy Reduction T. M. Khan Syed S. Naqvi A. Robles-Kelly Erik H. W. Meijering 41 7 0 14 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 49 68 0 08 Oct 2022
Approximate Computing and the Efficient Machine Learning Expedition J. Henkel Hai Helen Li A. Raghunathan M. Tahoori Swagath Venkataramani Xiaoxuan Yang Georgios Zervakis 20 17 0 02 Oct 2022
Sequential Attention for Feature Selection T. Yasuda M. Bateni Lin Chen Matthew Fahrbach Gang Fu Vahab Mirrokni 39 11 0 29 Sep 2022
MiNL: Micro-images based Neural Representation for Light Fields Ziru Xu Henan Wang Zhibo Chen 33 1 0 17 Sep 2022
Semi-supervised classification using a supervised autoencoder for biomedical applications Cyprien Gille F. Guyard Michel Barlaud 16 3 0 22 Aug 2022
A One-Shot Reparameterization Method for Reducing the Loss of Tile Pruning on DNNs Yancheng Li Qingzhong Ai Fumihiko Ino 32 0 0 29 Jul 2022
Debiasing Deep Chest X-Ray Classifiers using Intra- and Post-processing Methods Ricards Marcinkevics Ece Ozkan Julia E. Vogt 25 18 0 26 Jul 2022
Compiler-Aware Neural Architecture Search for On-Mobile Real-time Super-Resolution Yushu Wu Yifan Gong Pu Zhao Yanyu Li Zheng Zhan Wei Niu Hao Tang Minghai Qin Bin Ren Yanzhi Wang SupR MQ 35 23 0 25 Jul 2022
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications Deniz Gunduz Zhijin Qin Iñaki Estella Aguerri Harpreet S. Dhillon Zhaohui Yang Aylin Yener Kai‐Kit Wong C. Chae 27 433 0 19 Jul 2022
DropNet: Reducing Neural Network Complexity via Iterative Pruning Chong Min John Tan Mehul Motani 32 52 0 14 Jul 2022
Exploring Lottery Ticket Hypothesis in Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Ruokai Yin Priyadarshini Panda 30 46 0 04 Jul 2022
Cut Inner Layers: A Structured Pruning Strategy for Efficient U-Net GANs Bo-Kyeong Kim Shinkook Choi Hancheol Park 21 4 0 29 Jun 2022
Augmented Imagefication: A Data-driven Fault Detection Method for Aircraft Air Data Sensors Hang Zhao Jinyi Ma Zhongzhi Li Yiqun Dong J. Ai 24 0 0 18 Jun 2022
Fast Lossless Neural Compression with Integer-Only Discrete Flows Siyu Wang Jianfei Chen Chongxuan Li Jun Zhu Bo Zhang MQ 23 7 0 17 Jun 2022
Leveraging Structured Pruning of Convolutional Neural Networks Hugo Tessier Vincent Gripon Mathieu Léonardon M. Arzel David Bertrand T. Hannagan CVBM 21 1 0 13 Jun 2022
SDQ: Stochastic Differentiable Quantization with Mixed Precision Xijie Huang Zhiqiang Shen Shichao Li Zechun Liu Xianghong Hu Jeffry Wicaksana Eric P. Xing Kwang-Ting Cheng MQ 21 33 0 09 Jun 2022
The Spike Gating Flow: A Hierarchical Structure Based Spiking Neural Network for Online Gesture Recognition Zihao Zhao Yanhong Wang Qiaosha Zou Tie Xu Fangbo Tao Jiansong Zhang Xiaoan Wang Chuanjin Richard Shi Junwen Luo Yuan Xie 45 1 0 04 Jun 2022
DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks Y. Fu Haichuan Yang Jiayi Yuan Meng Li Cheng Wan Raghuraman Krishnamoorthi Vikas Chandra Yingyan Lin 36 19 0 02 Jun 2022
Compression-aware Training of Neural Networks using Frank-Wolfe Max Zimmer Christoph Spiegel Sebastian Pokutta 29 9 0 24 May 2022
EdgeViTs: Competing Light-weight CNNs on Mobile Devices with Vision Transformers Junting Pan Adrian Bulat Fuwen Tan Xiatian Zhu L. Dudziak Hongsheng Li Georgios Tzimiropoulos Brais Martínez ViT 31 181 0 06 May 2022
Searching Intrinsic Dimensions of Vision Transformers Fanghui Xue Biao Yang Y. Qi Jack Xin ViT 41 2 0 16 Apr 2022
VisCUIT: Visual Auditor for Bias in CNN Image Classifier Seongmin Lee Zijie J. Wang Judy Hoffman Duen Horng Chau 24 11 0 12 Apr 2022
LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification Sharath Girish Kamal Gupta Saurabh Singh Abhinav Shrivastava 36 11 0 06 Apr 2022
ConceptExplainer: Interactive Explanation for Deep Neural Networks from a Concept Perspective Jinbin Huang Aditi Mishra Bum Chul Kwon Chris Bryan FAtt HAI 46 31 0 04 Apr 2022
Minimum Variance Unbiased N:M Sparsity for the Neural Gradients Brian Chmiel Itay Hubara Ron Banner Daniel Soudry 21 10 0 21 Mar 2022
Learning Compressed Embeddings for On-Device Inference Niketan Pansare J. Katukuri Aditya Arora F. Cipollone R. Shaik Noyan Tokgozoglu Chandru Venkataraman 37 14 0 18 Mar 2022
Mixture-of-Rookies: Saving DNN Computations by Predicting ReLU Outputs D. Pinto J. Arnau Antonio González 33 1 0 10 Feb 2022
Accelerating DNN Training with Structured Data Gradient Pruning Bradley McDanel Helia Dinh J. Magallanes 17 7 0 01 Feb 2022
A Secure and Efficient Federated Learning Framework for NLP Jieren Deng Chenghong Wang Xianrui Meng Yijue Wang Ji Li Sheng Lin Shuo Han Fei Miao Sanguthevar Rajasekaran Caiwen Ding FedML 77 22 0 28 Jan 2022
On the Convergence of Heterogeneous Federated Learning with Arbitrary Adaptive Online Model Pruning Hanhan Zhou Tian-Shing Lan Guru Venkataramani Wenbo Ding FedML 32 6 0 27 Jan 2022
Pruning-aware Sparse Regularization for Network Pruning Nanfei Jiang Xu Zhao Chaoyang Zhao Yongqi An Ming Tang Jinqiao Wang 3DPC 24 12 0 18 Jan 2022
GhostNets on Heterogeneous Devices via Cheap Operations Kai Han Yunhe Wang Chang Xu Jianyuan Guo Chunjing Xu Enhua Wu Qi Tian 19 102 0 10 Jan 2022
Sparse Super-Regular Networks Andrew W. E. McDonald A. Shokoufandeh 9 5 0 04 Jan 2022
Multi-Dimensional Model Compression of Vision Transformer Zejiang Hou S. Kung ViT 25 16 0 31 Dec 2021