Learning Sparse Neural Networks through $L_0$ Regularization

4 December 2017

Papers citing "Learning Sparse Neural Networks through $L_0$ Regularization"

50 / 221 papers shown

Title
Considering Layerwise Importance in the Lottery Ticket Hypothesis Benjamin Vandersmissen José Oramas 37 1 0 22 Feb 2023
FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning Anran Li Hongyi Peng Lan Zhang Jiahui Huang Qing Guo Han Yu Yang Liu FedML 39 28 0 21 Feb 2023
DAG Learning on the Permutahedron Valentina Zantedeschi Luca Franceschi Jean Kaddour Matt J. Kusner Vlad Niculae 29 11 0 27 Jan 2023
Rewarded meta-pruning: Meta Learning with Rewards for Channel Pruning Athul Shibu Abhishek Kumar Heechul Jung Dong-Gyu Lee 19 1 0 26 Jan 2023
Model Agnostic Sample Reweighting for Out-of-Distribution Learning Xiao Zhou Yong Lin Renjie Pi Weizhong Zhang Renzhe Xu Peng Cui Tong Zhang OODD 44 61 0 24 Jan 2023
SpArX: Sparse Argumentative Explanations for Neural Networks [Technical Report] Hamed Ayoobi Nico Potyka Francesca Toni 26 18 0 23 Jan 2023
Learnable Heterogeneous Convolution: Learning both topology and strength Rongzhen Zhao Zhenzhi Wu Qikun Zhang 35 6 0 13 Jan 2023
Inversion of Bayesian Networks Jesse van Oostrum Peter van Hintum Nihat Ay BDL 24 1 0 20 Dec 2022
Training Lightweight Graph Convolutional Networks with Phase-field Models H. Sahbi 32 0 0 19 Dec 2022
Gradient-based Intra-attention Pruning on Pre-trained Language Models Ziqing Yang Yiming Cui Xin Yao Shijin Wang VLM 42 8 0 15 Dec 2022
CSQ: Growing Mixed-Precision Quantization Scheme with Bi-level Continuous Sparsification Lirui Xiao Huanrui Yang Zhen Dong Kurt Keutzer Li Du Shanghang Zhang MQ 29 10 0 06 Dec 2022
Robust Training of Graph Neural Networks via Noise Governance Siyi Qian Haochao Ying Renjun Hu Jingbo Zhou Jintai Chen Danny Chen Jian Wu NoLa 43 34 0 12 Nov 2022
Accounting for Temporal Variability in Functional Magnetic Resonance Imaging Improves Prediction of Intelligence Yongqian Li Xin Ma Rajshekhar Sunderraman Shihao Ji Suprateek Kundu 30 6 0 11 Nov 2022
Robust Lottery Tickets for Pre-trained Language Models Rui Zheng Rong Bao Yuhao Zhou Di Liang Sirui Wang Wei Wu Tao Gui Qi Zhang Xuanjing Huang AAML 34 13 0 06 Nov 2022
Parameter-Efficient Tuning Makes a Good Classification Head Zhuoyi Yang Ming Ding Yanhui Guo Qingsong Lv Jie Tang VLM 65 14 0 30 Oct 2022
LOFT: Finding Lottery Tickets through Filter-wise Training Qihan Wang Chen Dun Fangshuo Liao C. Jermaine Anastasios Kyrillidis 35 3 0 28 Oct 2022
Sparsity in Continuous-Depth Neural Networks H. Aliee Till Richter Mikhail Solonin I. Ibarra Fabian J. Theis Niki Kilbertus 39 10 0 26 Oct 2022
Compressing And Debiasing Vision-Language Pre-Trained Models for Visual Question Answering Q. Si Yuanxin Liu Zheng Lin Peng Fu Weiping Wang VLM 44 1 0 26 Oct 2022
OLLA: Optimizing the Lifetime and Location of Arrays to Reduce the Memory Usage of Neural Networks Benoit Steiner Mostafa Elhoushi Jacob Kahn James Hegarty 33 8 0 24 Oct 2022
Pruning by Active Attention Manipulation Z. Babaiee Lucas Liebenwein Ramin Hasani Daniela Rus Radu Grosu 24 0 0 20 Oct 2022
Packed-Ensembles for Efficient Uncertainty Estimation Olivier Laurent Adrien Lafage Enzo Tartaglione Geoffrey Daniel Jean-Marc Martinez Andrei Bursuc Gianni Franchi OODD 46 32 0 17 Oct 2022
The Open-World Lottery Ticket Hypothesis for OOD Intent Classification Yunhua Zhou Pengyu Wang Peiju Liu Yuxin Wang Xipeng Qiu 36 2 0 13 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 56 68 0 08 Oct 2022
Differentiable Mathematical Programming for Object-Centric Representation Learning Adeel Pervez Phillip Lippe E. Gavves OCL 49 5 0 05 Oct 2022
Sequential Attention for Feature Selection T. Yasuda M. Bateni Lin Chen Matthew Fahrbach Gang Fu Vahab Mirrokni 41 11 0 29 Sep 2022
Make Heterophily Graphs Better Fit GNN: A Graph Rewiring Approach Wendong Bi Lun Du Qiang Fu Yanlin Wang Shi Han Dongmei Zhang 30 27 0 17 Sep 2022
The Role Of Biology In Deep Learning Robert Bain 29 0 0 07 Sep 2022
What to Prune and What Not to Prune at Initialization Maha Haroon 18 0 0 06 Sep 2022
Efficient Methods for Natural Language Processing: A Survey Marcos Vinícius Treviso Ji-Ung Lee Tianchu Ji Betty van Aken Qingqing Cao ... Emma Strubell Niranjan Balasubramanian Leon Derczynski Iryna Gurevych Roy Schwartz 40 109 0 31 Aug 2022
Mixed-Precision Neural Networks: A Survey M. Rakka M. Fouda Pramod P. Khargonekar Fadi J. Kurdahi MQ 30 11 0 11 Aug 2022
SBPF: Sensitiveness Based Pruning Framework For Convolutional Neural Network On Image Classification Yihe Lu Maoguo Gong Wei Zhao Kaiyuan Feng Hao Li VLM 29 0 0 09 Aug 2022
Doge Tickets: Uncovering Domain-general Language Models by Playing Lottery Tickets Yi Yang Chen Zhang Benyou Wang Dawei Song LRM 31 6 0 20 Jul 2022
Probing via Prompting Jiaoda Li Ryan Cotterell Mrinmaya Sachan 37 13 0 04 Jul 2022
Detecting Arbitrary Order Beneficial Feature Interactions for Recommender Systems Yixin Su Yunxiang Zhao S. Erfani Junhao Gan Rui Zhang 175 24 0 28 Jun 2022
PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance Qingru Zhang Simiao Zuo Chen Liang Alexander Bukharin Pengcheng He Weizhu Chen T. Zhao 27 78 0 25 Jun 2022
Winning the Lottery Ahead of Time: Efficient Early Network Pruning John Rachwan Daniel Zügner Bertrand Charpentier Simon Geisler Morgane Ayle Stephan Günnemann 32 24 0 21 Jun 2022
Sparse Double Descent: Where Network Pruning Aggravates Overfitting Zhengqi He Zeke Xie Quanzhi Zhu Zengchang Qin 86 27 0 17 Jun 2022
Sparse Structure Search for Parameter-Efficient Tuning Shengding Hu Zhen Zhang Ning Ding Yadao Wang Yasheng Wang Zhiyuan Liu Maosong Sun 39 16 0 15 Jun 2022
Spartan: Differentiable Sparsity via Regularized Transportation Kai Sheng Tai Taipeng Tian Ser-Nam Lim 34 11 0 27 May 2022
Language Anisotropic Cross-Lingual Model Editing Yang Xu Yutai Hou Wanxiang Che Min Zhang KELM 104 25 0 25 May 2022
PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection Linfeng Zhang Runpei Dong Hung-Shuo Tai Kaisheng Ma 3DPC 72 47 0 23 May 2022
Fast Conditional Network Compression Using Bayesian HyperNetworks Phuoc Nguyen T. Tran Ky Le Sunil R. Gupta Santu Rana Dang Nguyen Trong Nguyen S. Ryan Svetha Venkatesh BDL 30 6 0 13 May 2022
AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks Chin-Lun Fu Zih-Ching Chen Yun-Ru Lee Hung-yi Lee 35 44 0 30 Apr 2022
RAPQ: Rescuing Accuracy for Power-of-Two Low-bit Post-training Quantization Hongyi Yao Pu Li Jian Cao Xiangcheng Liu Chenying Xie Bin Wang MQ 32 12 0 26 Apr 2022
Merging of neural networks Martin Pasen Vladimír Boza FedML MoMe 30 2 0 21 Apr 2022
Accelerating Attention through Gradient-Based Learned Runtime Pruning Zheng Li Soroush Ghodrati Amir Yazdanbakhsh H. Esmaeilzadeh Mingu Kang 27 17 0 07 Apr 2022
LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification Sharath Girish Kamal Gupta Saurabh Singh Abhinav Shrivastava 40 11 0 06 Apr 2022
Structured Pruning Learns Compact and Accurate Models Mengzhou Xia Zexuan Zhong Danqi Chen VLM 24 180 0 01 Apr 2022
Explainability in Graph Neural Networks: An Experimental Survey Peibo Li Yixing Yang Maurice Pagnucco Yang Song 29 31 0 17 Mar 2022
Lightweight Jet Reconstruction and Identification as an Object Detection Task Adrian Alan Pol T. Aarrestad E. Govorkova Roi Halily Anat Klempner ... Vladimir Loncar J. Ngadiuba M. Pierini Olya Sirkin S. Summers 32 2 0 09 Feb 2022