Learning Structured Sparsity in Deep Neural Networks

12 August 2016

Yiran Chen

Papers citing "Learning Structured Sparsity in Deep Neural Networks"

50 / 331 papers shown

Title
BRDS: An FPGA-based LSTM Accelerator with Row-Balanced Dual-Ratio Sparsification Seyed Abolfazl Ghasemzadeh E. Tavakoli M. Kamal A. Afzali-Kusha Massoud Pedram 19 13 0 07 Jan 2021
Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework Sung-En Chang Yanyu Li Mengshu Sun Runbin Shi Hayden Kwok-Hay So Xuehai Qian Yanzhi Wang Xue Lin MQ 26 82 0 08 Dec 2020
DiffPrune: Neural Network Pruning with Deterministic Approximate Binary Gates and $L_0$ Regularization Yaniv Shulman 46 3 0 07 Dec 2020
Bringing AI To Edge: From Deep Learning's Perspective Di Liu Hao Kong Xiangzhong Luo Weichen Liu Ravi Subramaniam 52 116 0 25 Nov 2020
Auto Graph Encoder-Decoder for Neural Network Pruning Sixing Yu Arya Mazaheri Ali Jannesari GNN 27 38 0 25 Nov 2020
BARS: Joint Search of Cell Topology and Layout for Accurate and Efficient Binary ARchitectures Tianchen Zhao Xuefei Ning Xiangsheng Shi Songyi Yang Shuang Liang Peng Lei Jianfei Chen Huazhong Yang Yu Wang MQ 26 7 0 21 Nov 2020
LOss-Based SensiTivity rEgulaRization: towards deep sparse neural networks Enzo Tartaglione Andrea Bragagnolo A. Fiandrotti Marco Grangetto ODL UQCV 20 34 0 16 Nov 2020
Dirichlet Pruning for Neural Network Compression Kamil Adamczewski Mijung Park 27 3 0 10 Nov 2020
Neural Network Compression Via Sparse Optimization Tianyi Chen Bo Ji Yixin Shi Tianyu Ding Biyi Fang Sheng Yi Xiao Tu 36 15 0 10 Nov 2020
Parameter Efficient Deep Neural Networks with Bilinear Projections Litao Yu Yongsheng Gao Jun Zhou Jian Zhang 21 1 0 03 Nov 2020
Self-grouping Convolutional Neural Networks Qingbei Guo Xiaojun Wu J. Kittler Zhiquan Feng 25 22 0 29 Sep 2020
Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot Jingtong Su Yihang Chen Tianle Cai Tianhao Wu Ruiqi Gao Liwei Wang J. Lee 14 85 0 22 Sep 2020
Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning Bingbing Li Zhenglun Kong Tianyun Zhang Ji Li Zechao Li Hang Liu Caiwen Ding VLM 32 64 0 17 Sep 2020
Accelerating Sparse DNN Models without Hardware-Support via Tile-Wise Sparsity Cong Guo B. Hsueh Jingwen Leng Yuxian Qiu Yue Guan Zehuan Wang Xiaoying Jia Xipeng Li M. Guo Yuhao Zhu 35 1 0 29 Aug 2020
Training Sparse Neural Networks using Compressed Sensing Jonathan W. Siegel Jianhong Chen Pengchuan Zhang Jinchao Xu 26 5 0 21 Aug 2020
Differentiable Feature Aggregation Search for Knowledge Distillation Yushuo Guan Pengyu Zhao Bingxuan Wang Yuanxing Zhang Cong Yao Kaigui Bian Jian Tang FedML 17 44 0 02 Aug 2020
Standing on the Shoulders of Giants: Hardware and Neural Architecture Co-Search with Hot Start Weiwen Jiang Lei Yang Sakyasingha Dasgupta Jiaxi Hu Yiyu Shi 27 59 0 17 Jul 2020
Learning with Privileged Information for Efficient Image Super-Resolution Wonkyung Lee Junghyup Lee Dohyung Kim Bumsub Ham 33 134 0 15 Jul 2020
A General Family of Stochastic Proximal Gradient Methods for Deep Learning Jihun Yun A. Lozano Eunho Yang 20 12 0 15 Jul 2020
T-Basis: a Compact Representation for Neural Networks Anton Obukhov M. Rakhuba Stamatios Georgoulis Menelaos Kanakis Dengxin Dai Luc Van Gool 39 27 0 13 Jul 2020
Term Revealing: Furthering Quantization at Run Time on Quantized DNNs H. T. Kung Bradley McDanel S. Zhang MQ 21 9 0 13 Jul 2020
Operation-Aware Soft Channel Pruning using Differentiable Masks Minsoo Kang Bohyung Han AAML 35 138 0 08 Jul 2020
Enabling On-Device CNN Training by Self-Supervised Instance Filtering and Error Map Pruning Yawen Wu Zhepeng Wang Yiyu Shi Jiaxi Hu 18 44 0 07 Jul 2020
Self-Supervised GAN Compression Chong Yu Jeff Pool 9 9 0 03 Jul 2020
Hardware Acceleration of Sparse and Irregular Tensor Computations of ML Models: A Survey and Insights Shail Dave Riyadh Baghdadi Tony Nowatzki Sasikanth Avancha Aviral Shrivastava Baoxin Li 59 82 0 02 Jul 2020
Layer Sparsity in Neural Networks Mohamed Hebiri Johannes Lederer 36 10 0 28 Jun 2020
Embedding Differentiable Sparsity into Deep Neural Network Yongjin Lee 16 0 0 23 Jun 2020
Optimal Lottery Tickets via SubsetSum: Logarithmic Over-Parameterization is Sufficient Ankit Pensia Shashank Rajput Alliot Nagle Harit Vishwakarma Dimitris Papailiopoulos 24 102 0 14 Jun 2020
A Framework for Neural Network Pruning Using Gibbs Distributions Alex Labach S. Valaee 9 5 0 08 Jun 2020
An Overview of Neural Network Compression James OÑeill AI4CE 45 98 0 05 Jun 2020
TinyLSTMs: Efficient Neural Speech Enhancement for Hearing Aids Igor Fedorov Marko Stamenovic Carl R. Jensen Li-Chia Yang Ari Mandell Yiming Gan Matthew Mattina P. Whatmough 16 96 0 20 May 2020
Generalized Bayesian Posterior Expectation Distillation for Deep Neural Networks Meet P. Vadera B. Jalaeian Benjamin M. Marlin BDL FedML UQCV 17 20 0 16 May 2020
CSB-RNN: A Faster-than-Realtime RNN Acceleration Framework with Compressed Structured Blocks Runbin Shi Peiyan Dong Tong Geng Yuhao Ding Xiaolong Ma Hayden Kwok-Hay So Martin C. Herbordt Ang Li Yanzhi Wang MQ 15 13 0 11 May 2020
Ensembled sparse-input hierarchical networks for high-dimensional datasets Jean Feng N. Simon 19 4 0 11 May 2020
Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey Jiayi Liu S. Tripathi Unmesh Kurup Mohak Shah 3DPC MedIm 30 52 0 08 May 2020
Data-Free Network Quantization With Adversarial Knowledge Distillation Yoojin Choi Jihwan P. Choi Mostafa El-Khamy Jungwon Lee MQ 27 119 0 08 May 2020
FlexSA: Flexible Systolic Array Architecture for Efficient Pruned DNN Model Training Sangkug Lym M. Erez 18 25 0 27 Apr 2020
Computation on Sparse Neural Networks: an Inspiration for Future Hardware Fei Sun Minghai Qin Tianyun Zhang Liu Liu Yen-kuang Chen Yuan Xie 34 7 0 24 Apr 2020
PERMDNN: Efficient Compressed DNN Architecture with Permuted Diagonal Matrices Chunhua Deng Siyu Liao Yi Xie Keshab K. Parhi Xuehai Qian Bo Yuan 38 93 0 23 Apr 2020
Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsification Huanrui Yang Minxue Tang W. Wen Feng Yan Daniel Hu Ang Li H. Li Yiran Chen 36 63 0 20 Apr 2020
Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks Kakeru Mitsuno J. Miyao Takio Kurita 21 16 0 09 Apr 2020
DSA: More Efficient Budgeted Pruning via Differentiable Sparsity Allocation Xuefei Ning Tianchen Zhao Wenshuo Li Peng Lei Yu Wang Huazhong Yang 24 103 0 05 Apr 2020
Introducing Pose Consistency and Warp-Alignment for Self-Supervised 6D Object Pose Estimation in Color Images Juil Sock Guillermo Garcia-Hernando Anil Armagan Tae-Kyun Kim 24 5 0 27 Mar 2020
A Survey of Methods for Low-Power Deep Learning and Computer Vision Abhinav Goel Caleb Tung Yung-Hsiang Lu George K. Thiruvathukal VLM 15 92 0 24 Mar 2020
GAN Compression: Efficient Architectures for Interactive Conditional GANs Muyang Li Ji Lin Yaoyao Ding Zhijian Liu Jun-Yan Zhu Song Han GAN 22 2 0 19 Mar 2020
Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression Yawei Li Shuhang Gu Christoph Mayer Luc Van Gool Radu Timofte 137 189 0 19 Mar 2020
MINT: Deep Network Compression via Mutual Information-based Neuron Trimming Madan Ravi Ganesh Jason J. Corso Salimeh Yasaei Sekeh MQ 43 15 0 18 Mar 2020
SASL: Saliency-Adaptive Sparsity Learning for Neural Network Acceleration Jun Shi Jianfeng Xu K. Tasaka Zhibo Chen 6 25 0 12 Mar 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 26 326 0 22 Feb 2020
BinaryDuo: Reducing Gradient Mismatch in Binary Activation Network by Coupling Binary Activations Hyungjun Kim Kyungsu Kim Jinseok Kim Jae-Joon Kim MQ 27 47 0 16 Feb 2020