Group Sparse Regularization for Deep Neural Networks

2 July 2016

Amir Hussain

Papers citing "Group Sparse Regularization for Deep Neural Networks"

50 / 63 papers shown

Title
Sparsity is All You Need: Rethinking Biological Pathway-Informed Approaches in Deep Learning Isabella Caranzano Corrado Pancotti Cesare Rollo Flavio Sartori Pietro Liò P. Fariselli Tiziana Sanavia OOD UQCV 65 0 0 07 May 2025
SAND: One-Shot Feature Selection with Additive Noise Distortion P. Pad Hadi Hammoud Mohamad Dia Nadim Maamari L. A. Dunbar 28 0 0 06 May 2025
Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries Chris Kolb T. Weber Bernd Bischl David Rügamer 115 0 0 04 Feb 2025
Implicit Bias in Matrix Factorization and its Explicit Realization in a New Architecture Yikun Hou Suvrit Sra A. Yurtsever 34 0 0 28 Jan 2025
Meta-Sparsity: Learning Optimal Sparse Structures in Multi-task Networks through Meta-learning Richa Upadhyay Ronald Phlypo Rajkumar Saini Marcus Liwicki 42 0 0 21 Jan 2025
Generative adversarial learning with optimal input dimension and its adaptive generator architecture Zhiyao Tan Ling Zhou Huazhen Lin GAN 44 0 0 06 May 2024
Bayesian Federated Model Compression for Communication and Computation Efficiency Cheng-Gang Xia Danny H. K. Tsang Vincent K. N. Lau 28 0 0 11 Apr 2024
GD doesn't make the cut: Three ways that non-differentiability affects neural network training Siddharth Krishna Kumar AAML 31 2 0 16 Jan 2024
Continual Learning of Diffusion Models with Generative Distillation Sergi Masip Pau Rodriguez Tinne Tuytelaars Gido M. van de Ven VLM DiffM 43 8 0 23 Nov 2023
End-to-end Feature Selection Approach for Learning Skinny Trees Shibal Ibrahim Kayhan Behdin Rahul Mazumder 30 0 0 28 Oct 2023
How a student becomes a teacher: learning and forgetting through Spectral methods Lorenzo Giambagli L. Buffoni Lorenzo Chicchi Duccio Fanelli 19 7 0 19 Oct 2023
Provable Identifiability of Two-Layer ReLU Neural Networks via LASSO Regularization Geng Li G. Wang Jie Ding 34 3 0 07 May 2023
Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models? Boris Knyazev Doha Hwang Simon Lacoste-Julien AI4CE 39 17 0 07 Mar 2023
A Multi-Agent Adaptive Deep Learning Framework for Online Intrusion Detection Mahdi Soltani Khashayar Khajavi M. J. Siavoshani A. Jahangir 22 7 0 05 Mar 2023
Structured Pruning of Self-Supervised Pre-trained Models for Speech Recognition and Understanding Yifan Peng Kwangyoun Kim Felix Wu Prashant Sridhar Shinji Watanabe 32 34 0 27 Feb 2023
SPARLING: Learning Latent Representations with Extremely Sparse Activations Kavi Gupta Osbert Bastani Armando Solar-Lezama 21 1 0 03 Feb 2023
The Contextual Lasso: Sparse Linear Models via Deep Neural Networks Ryan Thompson Amir Dezfouli Robert Kohn 35 4 0 02 Feb 2023
Semiparametric Regression for Spatial Data via Deep Learning Kexuan Li Jun Zhu A. Ives V. Radeloff Fangfang Wang 28 8 0 10 Jan 2023
Statistical guarantees for sparse deep learning Johannes Lederer 24 11 0 11 Dec 2022
Fast and Low-Memory Deep Neural Networks Using Binary Matrix Factorization Alireza Bordbar M. Kahaei MQ 33 0 0 24 Oct 2022
Sequential Attention for Feature Selection T. Yasuda M. Bateni Lin Chen Matthew Fahrbach Gang Fu Vahab Mirrokni 39 11 0 29 Sep 2022
Deep neural networks with dependent weights: Gaussian Process mixture limit, heavy tails, sparsity and compressibility Hoileong Lee Fadhel Ayed Paul Jung Juho Lee Hongseok Yang François Caron 48 10 0 17 May 2022
Statistical Guarantees for Approximate Stationary Points of Simple Neural Networks Mahsa Taheri Fang Xie Johannes Lederer 31 0 0 09 May 2022
$On the Compression of Neural Networks Using $\ell_0$-Norm Regularization and Weight Pruning$ On the Compression of Neural Networks Using $\ell_0$ -Norm Regularization and Weight Pruning F. Oliveira E. Batista R. Seara 20 9 0 10 Sep 2021
Adaptive Group Lasso Neural Network Models for Functions of Few Variables and Time-Dependent Data L. Ho Nicholas Richardson Giang Tran 20 3 0 24 Aug 2021
Lockout: Sparse Regularization of Neural Networks Gilmer Valdes W. Arbelo Y. Interian J. Friedman 19 2 0 15 Jul 2021
Unsupervised Deep Learning by Injecting Low-Rank and Sparse Priors T. Sakai SSL 27 0 0 21 Jun 2021
A New Class of Efficient Adaptive Filters for Online Nonlinear Modeling Danilo Comminiello Alireza Nezamdoust Simone Scardapane M. Scarpiniti Amir Hussain A. Uncini 10 9 0 19 Apr 2021
Consistent Sparse Deep Learning: Theory and Computation Y. Sun Qifan Song F. Liang BDL 45 27 0 25 Feb 2021
End-to-end learnable EEG channel selection for deep neural networks with Gumbel-softmax Thomas Strypsteen Alexander Bertrand 33 50 0 11 Feb 2021
Deep learning insights into cosmological structure formation Luisa Lucie-Smith H. Peiris A. Pontzen Brian D. Nord Jeyan Thiyagalingam 24 6 0 20 Nov 2020
Parametric Flatten-T Swish: An Adaptive Non-linear Activation Function For Deep Learning Hock Hung Chieng Noorhaniza Wahid P. Ong 21 6 0 06 Nov 2020
DL-Reg: A Deep Learning Regularization Technique using Linear Regression Maryam Dialameh A. Hamzeh Hossein Rahmani 26 3 0 31 Oct 2020
Pruning Convolutional Filters using Batch Bridgeout Najeeb Khan Ian Stavness 28 3 0 23 Sep 2020
A Partial Regularization Method for Network Compression E. Zhenqian Weiguo Gao 18 0 0 03 Sep 2020
Continual BERT: Continual Learning for Adaptive Extractive Summarization of COVID-19 Literature Jongjin Park CLL 33 15 0 07 Jul 2020
Layer Sparsity in Neural Networks Mohamed Hebiri Johannes Lederer 36 10 0 28 Jun 2020
Momentum-based variance-reduced proximal stochastic gradient method for composite nonconvex stochastic optimization Yangyang Xu Yibo Xu 33 23 0 31 May 2020
Consistent feature selection for neural networks via Adaptive Group Lasso L. Ho Vu C. Dinh OOD 14 9 0 30 May 2020
Ensembled sparse-input hierarchical networks for high-dimensional datasets Jean Feng N. Simon 19 4 0 11 May 2020
Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks Kakeru Mitsuno J. Miyao Takio Kurita 21 16 0 09 Apr 2020
Machine Learning Techniques for Biomedical Image Segmentation: An Overview of Technical Aspects and Introduction to State-of-Art Applications Hyunseok Seo M. B. Khuzani V. Vasudevan Charles Huang Hongyi Ren Ruoxiu Xiao Xiao Jia Lei Xing VLM 24 218 0 06 Nov 2019
Active Subspace of Neural Networks: Structural Analysis and Universal Attacks Chunfeng Cui Kaiqi Zhang Talgat Daulbaev Julia Gusak Ivan Oseledets Zheng-Wei Zhang AAML 32 25 0 29 Oct 2019
ROBO: Robust, Fully Neural Object Detection for Robot Soccer Marton Szemenyei V. Estivill-Castro 25 5 0 24 Oct 2019
BEAN: Interpretable Representation Learning with Biologically-Enhanced Artificial Neuronal Assembly Regularization Yuyang Gao Giorgio Ascoli Liang Zhao 23 15 0 27 Sep 2019
Complexity-Scalable Neural Network Based MIMO Detection With Learnable Weight Scaling A. Mohammad C. Masouros Y. Andreopoulos 24 28 0 12 Sep 2019
VACL: Variance-Aware Cross-Layer Regularization for Pruning Deep Residual Networks Shuang Gao Xin Liu Lung-Sheng Chien William Zhang J. Álvarez VLM 3DPC 21 15 0 10 Sep 2019
RNN Architecture Learning with Sparse Regularization Jesse Dodge Roy Schwartz Hao Peng Noah A. Smith 20 10 0 06 Sep 2019
Adaptive Regularization via Residual Smoothing in Deep Learning Optimization Jung-Kyun Cho Junseok Kwon Byung-Woo Hong 31 1 0 23 Jul 2019
Improving performance of deep learning models with axiomatic attribution priors and expected gradients G. Erion Joseph D. Janizek Pascal Sturmfels Scott M. Lundberg Su-In Lee OOD BDL FAtt 21 80 0 25 Jun 2019