Learning both Weights and Connections for Efficient Neural Networks

8 June 2015

Song Han

Papers citing "Learning both Weights and Connections for Efficient Neural Networks"

50 / 1,144 papers shown

Title
Incrementally-Computable Neural Networks: Efficient Inference for Dynamic Inputs Or Sharir Anima Anandkumar 32 0 0 27 Jul 2023
Digital Modeling on Large Kernel Metamaterial Neural Network Quan Liu Hanyu Zheng Brandon T. Swartz Ho Hin Lee Zuhayr Asad I. Kravchenko Jason G Valentine Yuankai Huo 20 4 0 21 Jul 2023
Approximate Computing Survey, Part II: Application-Specific & Architectural Approximation Techniques and Applications Vasileios Leon Muhammad Abdullah Hanif Giorgos Armeniakos Xun Jiao Mohamed Bennai K. Pekmestzi Dimitrios Soudris 44 3 0 20 Jul 2023
Spatial-Spectral Hyperspectral Classification based on Learnable 3D Group Convolution Guandong Li M. Ye 31 6 0 15 Jul 2023
Exploring the Lottery Ticket Hypothesis with Explainability Methods: Insights into Sparse Network Performance Shantanu Ghosh Kayhan Batmanghelich 35 0 0 07 Jul 2023
Distilled Pruning: Using Synthetic Data to Win the Lottery Luke McDermott Daniel Cummings SyDa DD 36 1 0 07 Jul 2023
Data-Free Quantization via Mixed-Precision Compensation without Fine-Tuning Jun Chen Shipeng Bai Tianxin Huang Mengmeng Wang Guanzhong Tian Y. Liu MQ 44 18 0 02 Jul 2023
Filter Pruning for Efficient CNNs via Knowledge-driven Differential Filter Sampler Shaohui Lin Wenxuan Huang Jiao Xie Baochang Zhang Yunhang Shen Zhou Yu Jungong Han David Doermann 30 2 0 01 Jul 2023
An Efficient Sparse Inference Software Accelerator for Transformer-based Language Models on CPUs Haihao Shen Hengyu Meng Bo Dong Zhe Wang Ofir Zafrir ... Hanwen Chang Qun Gao Zi. Wang Guy Boudoukh Moshe Wasserblat MoE 41 4 0 28 Jun 2023
Quantifying lottery tickets under label noise: accuracy, calibration, and complexity V. Arora Daniele Irto Sebastian Goldt G. Sanguinetti 52 2 0 21 Jun 2023
A Simple and Effective Pruning Approach for Large Language Models Mingjie Sun Zhuang Liu Anna Bair J. Zico Kolter 90 364 0 20 Jun 2023
LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation Yixiao Li Yifan Yu Qingru Zhang Chen Liang Pengcheng He Weizhu Chen Tuo Zhao 49 69 0 20 Jun 2023
Magnificent Minified Models Richard E. Harang Hillary Sanders 19 0 0 16 Jun 2023
Spatial Re-parameterization for N:M Sparsity Yuxin Zhang Mingbao Lin Mingliang Xu Mengzhao Chen Rongrong Ji 48 2 0 09 Jun 2023
Magnitude Attention-based Dynamic Pruning Jihye Back Namhyuk Ahn Jang-Hyun Kim 43 2 0 08 Jun 2023
ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural Networks Jiangrong Shen Qi Xu Jian K. Liu Yueming Wang Gang Pan Huajin Tang 30 42 0 06 Jun 2023
Vision Transformers for Mobile Applications: A Short Survey Nahid Alam Steven Kolawole S. Sethi Nishant Bansali Karina Nguyen ViT 42 3 0 30 May 2023
A Transfer Learning and Explainable Solution to Detect mpox from Smartphones images M. Campana Marco Colussi Franca Delmastro S. Mascetti Elena Pagani 20 10 0 29 May 2023
Adaptive Sparsity Level during Training for Efficient Time Series Forecasting with Transformers Zahra Atashgahi Mykola Pechenizkiy Raymond N. J. Veldhuis Decebal Constantin Mocanu AI4TS AI4CE 39 1 0 28 May 2023
One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verification Ju-Sung Heo Chan-yeong Lim Ju-ho Kim Hyun-Seo Shin Ha-Jin Yu 31 2 0 27 May 2023
A Hybrid Neural Coding Approach for Pattern Recognition with Spiking Neural Networks Xinyi Chen Qu Yang Jibin Wu Haizhou Li Kay Chen Tan 30 16 0 26 May 2023
Sparse Weight Averaging with Multiple Particles for Iterative Magnitude Pruning Moonseok Choi Hyungi Lee G. Nam Juho Lee 45 2 0 24 May 2023
Masked Bayesian Neural Networks : Theoretical Guarantee and its Posterior Inference Insung Kong Dongyoon Yang Jongjin Lee Ilsang Ohn Gyuseung Baek Yongdai Kim BDL 43 4 0 24 May 2023
PruMUX: Augmenting Data Multiplexing with Model Compression Yushan Su Vishvak Murahari Karthik Narasimhan Keqin Li 30 3 0 24 May 2023
Selective Pre-training for Private Fine-tuning Da Yu Sivakanth Gopi Janardhan Kulkarni Zinan Lin Saurabh Naik Tomasz Religa Jian Yin Huishuai Zhang 43 19 0 23 May 2023
Lifting the Curse of Capacity Gap in Distilling Language Models Chen Zhang Yang Yang Jiahao Liu Jingang Wang Yunsen Xian Benyou Wang Dawei Song MoE 32 19 0 20 May 2023
SFP: Spurious Feature-targeted Pruning for Out-of-Distribution Generalization Yingchun Wang Jingcai Guo Yi Liu Song Guo Weizhan Zhang Xiangyong Cao Qinghua Zheng AAML OODD 45 11 0 19 May 2023
Lyapunov-Driven Deep Reinforcement Learning for Edge Inference Empowered by Reconfigurable Intelligent Surfaces Kyriakos Stylianopoulos M. Merluzzi P. Lorenzo G. C. Alexandropoulos 43 9 0 18 May 2023
Boost Vision Transformer with GPU-Friendly Sparsity and Quantization Chong Yu Tao Chen Zhongxue Gan Jiayuan Fan MQ ViT 39 23 0 18 May 2023
TIPS: Topologically Important Path Sampling for Anytime Neural Networks Guihong Li Kartikeya Bhardwaj Yuedong Yang R. Marculescu AAML 46 0 0 13 May 2023
SPADE: Sparse Pillar-based 3D Object Detection Accelerator for Autonomous Driving Minjae Lee Seongmin Park Hyung-Se Kim Minyong Yoon Jangwhan Lee Junwon Choi Nam Sung Kim Mingu Kang Jungwook Choi 3DPC 26 5 0 12 May 2023
Seeing is Believing: Brain-Inspired Modular Training for Mechanistic Interpretability Ziming Liu Eric Gan Max Tegmark 31 36 0 04 May 2023
Cuttlefish: Low-Rank Model Training without All the Tuning Hongyi Wang Saurabh Agarwal Pongsakorn U-chupala Yoshiki Tanaka Eric P. Xing Dimitris Papailiopoulos OffRL 65 22 0 04 May 2023
TorchBench: Benchmarking PyTorch with High API Surface Coverage Yueming Hao Xu Zhao Bin Bao David Berard William Constable Adnan Aziz Xu Liu 43 5 0 27 Apr 2023
Continual Domain Adaptation through Pruning-aided Domain-specific Weight Modulation B. Prasanna Sunandini Sanyal R. Venkatesh Babu CLL 34 4 0 15 Apr 2023
Training Large Language Models Efficiently with Sparsity and Dataflow V. Srinivasan Darshan Gandhi Urmish Thakker R. Prabhakar MoE 43 6 0 11 Apr 2023
A priori compression of convolutional neural networks for wave simulators Hamza Boukraichi N. Akkari F. Casenave David Ryckelynck 23 2 0 11 Apr 2023
Surrogate Lagrangian Relaxation: A Path To Retrain-free Deep Neural Network Pruning Shangli Zhou Mikhail A. Bragin Lynn Pepin Deniz Gurevin Fei Miao Caiwen Ding 29 3 0 08 Apr 2023
NTK-SAP: Improving neural network pruning by aligning training dynamics Yite Wang Dawei Li Ruoyu Sun 47 19 0 06 Apr 2023
$Physics-aware Roughness Optimization for Diffractive Optical Neural Networks$ Physics-aware Roughness Optimization for Diffractive Optical Neural Networks Shangli Zhou Yingjie Li Minhan Lou Weilu Gao Zhijie Shi Cunxi Yu Caiwen Ding 38 2 0 04 Apr 2023
SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer Xuanyao Chen Zhijian Liu Haotian Tang Li Yi Hang Zhao Song Han ViT 31 47 0 30 Mar 2023
Distributed Neural Representation for Reactive in situ Visualization Qi Wu J. Insley V. Mateevitsi S. Rizzi M. Papka Kwan-Liu Ma 37 1 0 28 Mar 2023
Compacting Binary Neural Networks by Sparse Kernel Selection Yikai Wang Wen-bing Huang Yinpeng Dong Gang Hua Anbang Yao MQ 41 4 0 25 Mar 2023
Learned Two-Plane Perspective Prior based Image Resampling for Efficient Object Detection Anurag Ghosh Dinesh Reddy Narapureddy Christoph Mertz S. Narasimhan 33 4 0 25 Mar 2023
Edge Deep Learning Model Protection via Neuron Authorization Jinyin Chen Haibin Zheng Tianming Liu Rongchang Li Yao Cheng Xuhong Zhang S. Ji FedML 31 0 0 22 Mar 2023
Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast Training Xinwei Ou Zhangxin Chen Ce Zhu Yipeng Liu 41 4 0 22 Mar 2023
Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency Vithursan Thangarasa Shreyas Saxena Abhay Gupta Sean Lie 41 3 0 21 Mar 2023
Induced Feature Selection by Structured Pruning Nathan Hubens V. Delvigne M. Mancas B. Gosselin Marius Preda T. Zaharia 22 0 0 20 Mar 2023
DC-CCL: Device-Cloud Collaborative Controlled Learning for Large Vision Models Yucheng Ding Chaoyue Niu Fan Wu Shaojie Tang Chengfei Lyu Guihai Chen 24 6 0 18 Mar 2023
SR-init: An interpretable layer pruning method Hui Tang Yao Lu Qi Xuan 20 9 0 14 Mar 2023