Learning both Weights and Connections for Efficient Neural Networks

8 June 2015

Song Han

Papers citing "Learning both Weights and Connections for Efficient Neural Networks"

50 / 1,147 papers shown

Title
A Rubric for Human-like Agents and NeuroAI Ida Momennejad 60 14 0 08 Dec 2022
Slimmable Pruned Neural Networks Hideaki Kuratsu Atsuyoshi Nakamura 22 2 0 07 Dec 2022
CSTAR: Towards Compact and STructured Deep Neural Networks with Adversarial Robustness Huy Phan Miao Yin Yang Sui Bo Yuan S. Zonouz AAML GNN 38 8 0 04 Dec 2022
FedKNOW: Federated Continual Learning with Signature Task Knowledge Integration at Edge Yaxin Luopan Rui Han Qinglong Zhang Chi Harold Liu Guoren Wang FedML 31 18 0 04 Dec 2022
The Effect of Data Dimensionality on Neural Network Prunability Zachary Ankner Alex Renda Gintare Karolina Dziugaite Jonathan Frankle Tian Jin 36 5 0 01 Dec 2022
Hint-dynamic Knowledge Distillation Yiyang Liu Chenxin Li Xiaotong Tu Xinghao Ding Yue Huang 19 1 0 30 Nov 2022
Boosted Dynamic Neural Networks Haichao Yu Haoxiang Li G. Hua Gao Huang Humphrey Shi 35 7 0 30 Nov 2022
MegaBlocks: Efficient Sparse Training with Mixture-of-Experts Trevor Gale Deepak Narayanan C. Young Matei A. Zaharia MoE 30 103 0 29 Nov 2022
Class-based Quantization for Neural Networks Wenhao Sun Grace Li Zhang Huaxi Gu Bing Li Ulf Schlichtmann MQ 24 7 0 27 Nov 2022
Exploring Temporal Information Dynamics in Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Anna Hambitzer Priyadarshini Panda 24 33 0 26 Nov 2022
LU decomposition and Toeplitz decomposition of a neural network Yucong Liu Simiao Jiao Lek-Heng Lim 30 7 0 25 Nov 2022
Structural Knowledge Distillation for Object Detection Philip de Rijk Lukas Schneider Marius Cordts D. Gavrila 32 24 0 23 Nov 2022
Cooperative data-driven modeling Aleksandr Dekhovich O. T. Turan Jiaxiang Yi Miguel A. Bessa CLL KELM AI4CE 24 5 0 23 Nov 2022
A Fair Loss Function for Network Pruning Robbie Meyer Alexander Wong CVBM 32 3 0 18 Nov 2022
Compressing Transformer-based self-supervised models for speech processing Tzu-Quan Lin Tsung-Huan Yang Chun-Yao Chang Kuang-Ming Chen Tzu-hsun Feng Hung-yi Lee Hao Tang 45 6 0 17 Nov 2022
Yield Evaluation of Citrus Fruits based on the YoloV5 compressed by Knowledge Distillation Yuqi Li Yuting He Yihang Zhou Zirui Gong Ren-Jun Huang 21 0 0 16 Nov 2022
Finding Skill Neurons in Pre-trained Transformer-based Language Models Xiaozhi Wang Kaiyue Wen Zhengyan Zhang Lei Hou Zhiyuan Liu Juanzi Li MILM MoE 34 51 0 14 Nov 2022
FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model Shuo Shao Wenyuan Yang Hanlin Gu Zhan Qin Lixin Fan Qiang Yang Kui Ren FedML 34 29 0 14 Nov 2022
Pruning Very Deep Neural Network Channels for Efficient Inference Yihui He 35 1 0 14 Nov 2022
Watermarking in Secure Federated Learning: A Verification Framework Based on Client-Side Backdooring Wenyuan Yang Shuo Shao Yue Yang Xiyao Liu Ximeng Liu Zhihua Xia Gerald Schaefer Hui Fang FedML 14 21 0 14 Nov 2022
Exploiting the Partly Scratch-off Lottery Ticket for Quantization-Aware Training Mingliang Xu Gongrui Nan Yuxin Zhang Rongrong Ji Rongrong Ji MQ 23 3 0 12 Nov 2022
MGiaD: Multigrid in all dimensions. Efficiency and robustness by coarsening in resolution and channel dimensions Antonia van Betteray Matthias Rottmann Karsten Kahl 34 2 0 10 Nov 2022
Deep Learning based Computer Vision Methods for Complex Traffic Environments Perception: A Review Talha Azfar Jinlong Li Hongkai Yu R. Cheu Yisheng Lv Ruimin Ke 43 21 0 09 Nov 2022
HFedMS: Heterogeneous Federated Learning with Memorable Data Semantics in Industrial Metaverse Shenglai Zeng Zonghang Li Hongfang Yu Zhihao Zhang Long Luo Yue Liu Dusit Niyato 49 42 0 07 Nov 2022
Intriguing Properties of Compression on Multilingual Models Kelechi Ogueji Orevaoghene Ahia Gbemileke Onilude Sebastian Gehrmann Sara Hooker Julia Kreutzer 33 12 0 04 Nov 2022
Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Models Zhekai Zhang Ji Lin Chenlin Meng Stefano Ermon Song Han Jun-Yan Zhu DiffM 45 45 0 03 Nov 2022
Data-Efficient Cross-Lingual Transfer with Language-Specific Subnetworks Rochelle Choenni Dan Garrette Ekaterina Shutova 39 2 0 31 Oct 2022
LearningGroup: A Real-Time Sparse Training on FPGA via Learnable Weight Grouping for Multi-Agent Reinforcement Learning Jenny Yang Jaeuk Kim Joo-Young Kim 31 2 0 29 Oct 2022
LOFT: Finding Lottery Tickets through Filter-wise Training Qihan Wang Chen Dun Fangshuo Liao C. Jermaine Anastasios Kyrillidis 38 3 0 28 Oct 2022
Introducing topography in convolutional neural networks Maxime Poli Emmanuel Dupoux Rachid Riad 37 0 0 28 Oct 2022
DICTION:DynamIC robusT whIte bOx watermarkiNg scheme for deep neural networks Reda Bellafqira Gouenou Coatrieux 24 5 0 27 Oct 2022
Compressing And Debiasing Vision-Language Pre-Trained Models for Visual Question Answering Q. Si Yuanxin Liu Zheng Lin Peng Fu Weiping Wang VLM 47 1 0 26 Oct 2022
Fast and Low-Memory Deep Neural Networks Using Binary Matrix Factorization Alireza Bordbar M. Kahaei MQ 33 0 0 24 Oct 2022
Compressing Explicit Voxel Grid Representations: fast NeRFs become also small C. Deng Enzo Tartaglione GNN 38 52 0 23 Oct 2022
Multitasking Models are Robust to Structural Failure: A Neural Model for Bilingual Cognitive Reserve Giannis Daras Negin Raoof Zoi Gkalitsiou A. Dimakis 35 2 0 20 Oct 2022
RSC: Accelerating Graph Neural Networks Training via Randomized Sparse Computations Zirui Liu Sheng-Wei Chen Kaixiong Zhou Daochen Zha Xiao Huang Xia Hu 42 15 0 19 Oct 2022
Predicting Oxide Glass Properties with Low Complexity Neural Network and Physical and Chemical Descriptors S. Bishnoi Skyler Badge J. Jayadeva N. M. A. Krishnan 11 10 0 19 Oct 2022
MotionDeltaCNN: Sparse CNN Inference of Frame Differences in Moving Camera Videos Mathias Parger Chengcheng Tang Thomas Neff Christopher D. Twigg Cem Keskin Robert Y. Wang M. Steinberger 32 6 0 18 Oct 2022
Approximating Continuous Convolutions for Deep Network Compression Theo W. Costain V. Prisacariu 38 0 0 17 Oct 2022
InFIP: An Explainable DNN Intellectual Property Protection Method based on Intrinsic Features Mingfu Xue Xin Wang Ying-Chang Wu S. Ni Yushu Zhang Weiqiang Liu 27 2 0 14 Oct 2022
Neural Network Compression by Joint Sparsity Promotion and Redundancy Reduction T. M. Khan Syed S. Naqvi A. Robles-Kelly Erik H. W. Meijering 51 7 0 14 Oct 2022
Parameter-Efficient Masking Networks Yue Bai Huan Wang Xu Ma Yitian Zhang Zhiqiang Tao Yun Fu 31 10 0 13 Oct 2022
Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks Charith Peris Lizhen Tan Thomas Gueudré Turan Gojayev Vivi Wei Gokmen Oz 32 4 0 10 Oct 2022
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters Shwai He Liang Ding Daize Dong Miao Zhang Dacheng Tao MoE 48 87 0 09 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 64 68 0 08 Oct 2022
Unmasking the Lottery Ticket Hypothesis: What's Encoded in a Winning Ticket's Mask? Mansheej Paul F. Chen Brett W. Larsen Jonathan Frankle Surya Ganguli Gintare Karolina Dziugaite UQCV 47 38 0 06 Oct 2022
Teaching Yourself: Graph Self-Distillation on Neighborhood for Node Classification Lirong Wu Jun Xia Haitao Lin Zhangyang Gao Zicheng Liu Guojiang Zhao Stan Z. Li 61 6 0 05 Oct 2022
Designing and Training of Lightweight Neural Networks on Edge Devices using Early Halting in Knowledge Distillation Rahul Mishra Hari Prabhat Gupta 45 8 0 30 Sep 2022
Bayesian Neural Networks for Geothermal Resource Assessment: Prediction with Uncertainty Stephen R. Brown W. Rodi Marco Seracini Chengxi Gu Michael Fehler J. Faulds Connor M. Smith S. Treitel 26 0 0 30 Sep 2022
Convolutional Neural Networks Quantization with Attention Binyi Wu Bernd Waschneck Christian Mayr MQ 26 1 0 30 Sep 2022