Learning both Weights and Connections for Efficient Neural Networks

8 June 2015

Song Han

Papers citing "Learning both Weights and Connections for Efficient Neural Networks"

50 / 1,254 papers shown

Title
UDC: Unified DNAS for Compressible TinyML Models Igor Fedorov Ramon Matas Hokchhay Tann Chu Zhou Matthew Mattina P. Whatmough AI4CE 39 13 0 15 Jan 2022
Weighting and Pruning based Ensemble Deep Random Vector Functional Link Network for Tabular Data Classification Qi-Shi Shi Ponnuthurai Nagaratnam Suganthan Rakesh Katuwal 18 22 0 15 Jan 2022
Recursive Least Squares for Training and Pruning Convolutional Neural Networks Tianzong Yu Chunyuan Zhang Yuan Wang Meng-tao Ma Qingwei Song 46 1 0 13 Jan 2022
GhostNets on Heterogeneous Devices via Cheap Operations Kai Han Yunhe Wang Chang Xu Jianyuan Guo Chunjing Xu Enhua Wu Qi Tian 24 103 0 10 Jan 2022
Problem-dependent attention and effort in neural networks with applications to image resolution and model selection Chris Rohlfs 42 4 0 05 Jan 2022
Speedup deep learning models on GPU by taking advantage of efficient unstructured pruning and bit-width reduction Marcin Pietroñ Dominik Zurek 35 13 0 28 Dec 2021
Over-the-Air Federated Multi-Task Learning Over MIMO Multiple Access Channels Chen Zhong Huiyuan Yang Xiaojun Yuan 40 28 0 27 Dec 2021
Learning Robust and Lightweight Model through Separable Structured Transformations Xian Wei Yanhui Huang Yang Xu Mingsong Chen Hai Lan Yuanxiang Li Zhongfeng Wang Xuan Tang OOD 32 0 0 27 Dec 2021
GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Design Sung Une Lee Boming Xia Yongan Zhang Ang Li Yingyan Lin GNN 65 48 0 22 Dec 2021
RepMLPNet: Hierarchical Vision MLP with Re-parameterized Locality Xiaohan Ding Honghao Chen Xinming Zhang Jungong Han Guiguang Ding 30 71 0 21 Dec 2021
Compact Multi-level Sparse Neural Networks with Input Independent Dynamic Rerouting Minghai Qin Tianyun Zhang Fei Sun Yen-kuang Chen M. Fardad Yanzhi Wang Yuan Xie 60 0 0 21 Dec 2021
Load-balanced Gather-scatter Patterns for Sparse Deep Neural Networks Fei Sun Minghai Qin Tianyun Zhang Xiaolong Ma Haoran Li Junwen Luo Zihao Zhao Yen-kuang Chen Yuan Xie 33 1 0 20 Dec 2021
Controlling the Quality of Distillation in Response-Based Network Compression Vibhas Kumar Vats David J. Crandall 26 1 0 19 Dec 2021
An Experimental Study of the Impact of Pre-training on the Pruning of a Convolutional Neural Network Nathan Hubens M. Mancas B. Gosselin Marius Preda T. Zaharia VLM CVBM 28 8 0 15 Dec 2021
From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression Runxin Xu Fuli Luo Chengyu Wang Baobao Chang Jun Huang Songfang Huang Fei Huang VLM 34 25 0 14 Dec 2021
Pruning Pretrained Encoders with a Multitask Objective Patrick Xia Richard Shin 52 0 0 10 Dec 2021
Network Compression via Central Filter Y. Duan Xiaofang Hu Yue Zhou Qiang Liu Shukai Duan 3DPC 27 1 0 10 Dec 2021
PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomics Zudi Lin D. Wei J. Lichtman Hanspeter Pfister 37 22 0 10 Dec 2021
i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery Cameron R. Wolfe Anastasios Kyrillidis 36 1 0 07 Dec 2021
Enhanced Exploration in Neural Feature Selection for Deep Click-Through Rate Prediction Models via Ensemble of Gating Layers L. Guan Xia Xiao Ming-yue Chen Youlong Cheng 32 1 0 07 Dec 2021
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models Tri Dao Beidi Chen Kaizhao Liang Jiaming Yang Zhao Song Atri Rudra Christopher Ré 38 76 0 30 Nov 2021
Mixed Precision Low-bit Quantization of Neural Network Language Models for Speech Recognition Junhao Xu Jianwei Yu Shoukang Hu Xunying Liu Helen Meng MQ 52 13 0 29 Nov 2021
Low-bit Quantization of Recurrent Neural Network Language Models Using Alternating Direction Methods of Multipliers Junhao Xu Xie Chen Shoukang Hu Jianwei Yu Xunying Liu Helen Meng MQ 30 9 0 29 Nov 2021
How Well Do Sparse Imagenet Models Transfer? Eugenia Iofinova Alexandra Peste Mark Kurtz Dan Alistarh 32 39 0 26 Nov 2021
Hidden-Fold Networks: Random Recurrent Residuals Using Sparse Supermasks Ángel López García-Arias Masanori Hashimoto Masato Motomura Jaehoon Yu 44 5 0 24 Nov 2021
A survey on multi-objective hyperparameter optimization algorithms for Machine Learning A. Hernández I. Nieuwenhuyse Sebastian Rojas Gonzalez 28 97 0 23 Nov 2021
Automatic Mapping of the Best-Suited DNN Pruning Schemes for Real-Time Mobile Acceleration Yifan Gong Geng Yuan Zheng Zhan Wei Niu Zhengang Li ... Sijia Liu Bin Ren Xue Lin Xulong Tang Yanzhi Wang 33 10 0 22 Nov 2021
Toward Compact Parameter Representations for Architecture-Agnostic Neural Network Compression Yuezhou Sun Wenlong Zhao Lijun Zhang Xiao Liu Hui Guan Matei A. Zaharia 49 0 0 19 Nov 2021
DICE: Leveraging Sparsification for Out-of-Distribution Detection Yiyou Sun Yixuan Li OODD 43 153 0 18 Nov 2021
Deep Network Approximation in Terms of Intrinsic Parameters Zuowei Shen Haizhao Yang Shijun Zhang 28 9 0 15 Nov 2021
Learning Interpretation with Explainable Knowledge Distillation Raed Alharbi Minh Nhat Vu My T. Thai 27 15 0 12 Nov 2021
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI Jiangchao Yao Shengyu Zhang Yang Yao Feng Wang Jianxin Ma ... Kun Kuang Chao-Xiang Wu Fei Wu Jingren Zhou Hongxia Yang 42 92 0 11 Nov 2021
Prune Once for All: Sparse Pre-Trained Language Models Ofir Zafrir Ariel Larey Guy Boudoukh Haihao Shen Moshe Wasserblat VLM 39 83 0 10 Nov 2021
Efficient Neural Network Training via Forward and Backward Propagation Sparsification Xiao Zhou Weizhong Zhang Zonghao Chen Shizhe Diao Tong Zhang 65 45 0 10 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 88 83 0 08 Nov 2021
DPNET: Dual-Path Network for Efficient Object Detectioj with Lightweight Self-Attention Huiming Shi Quan Zhou Yinghao Ni Xiaofu Wu Longin Jan Latecki ObjD 36 8 0 31 Oct 2021
You are caught stealing my winning lottery ticket! Making a lottery ticket claim its ownership Xuxi Chen Tianlong Chen Zhenyu Zhang Zhangyang Wang WIGM 40 22 0 30 Oct 2021
Gabor filter incorporated CNN for compression Akihiro Imamura N. Arizumi CVBM 33 2 0 29 Oct 2021
MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning Ji Lin Wei-Ming Chen Han Cai Chuang Gan Song Han 50 156 0 28 Oct 2021
RGP: Neural Network Pruning through Its Regular Graph Structure Zhuangzhi Chen Jingyang Xiang Yao Lu Qi Xuan Xiaoniu Yang 41 1 0 28 Oct 2021
Meta-Learning Sparse Implicit Neural Representations Jaehoon Lee Jihoon Tack Namhoon Lee Jinwoo Shin 42 45 0 27 Oct 2021
Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression Scheme Shaojie Li Jie Wu Xuefeng Xiao Rongrong Ji Xudong Mao Rongrong Ji 50 35 0 27 Oct 2021
CHIP: CHannel Independence-based Pruning for Compact Neural Networks Yang Sui Miao Yin Yi Xie Huy Phan S. Zonouz Bo Yuan VLM 40 130 0 26 Oct 2021
Instance-Conditional Knowledge Distillation for Object Detection Zijian Kang Peizhen Zhang Xinming Zhang Jian Sun N. Zheng 37 77 0 25 Oct 2021
A Layer-wise Adversarial-aware Quantization Optimization for Improving Robustness Chang Song Riya Ranjan H. Li MQ 21 4 0 23 Oct 2021
Probabilistic fine-tuning of pruning masks and PAC-Bayes self-bounded learning Soufiane Hayou Bo He Gintare Karolina Dziugaite 42 2 0 22 Oct 2021
Class-Discriminative CNN Compression Yuchen Liu D. Wentzlaff S. Kung 31 1 0 21 Oct 2021
Adaptive Distillation: Aggregating Knowledge from Multiple Paths for Efficient Distillation Sumanth Chennupati Mohammad Mahdi Kamani Zhongwei Cheng Lin Chen 40 4 0 19 Oct 2021
S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks Shiyu Liu Chong Min John Tan Mehul Motani CLL 34 4 0 17 Oct 2021
Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillation Shichang Zhang Yozen Liu Yizhou Sun Neil Shah 46 179 0 17 Oct 2021