Efficient Variational Inference for Sparse Deep Learning with Theoretical Guarantee

15 November 2020

Papers citing "Efficient Variational Inference for Sparse Deep Learning with Theoretical Guarantee"

31 / 31 papers shown

Title
Posterior and variational inference for deep neural networks with heavy-tailed weights Ismael Castillo Paul Egels BDL 98 4 0 05 Jun 2024
Deep Horseshoe Gaussian Processes Ismael Castillo Thibault Randrianarisoa BDL UQCV 90 5 0 04 Mar 2024
An Adaptive Empirical Bayesian Method for Sparse Deep Learning Wei Deng Xiao Zhang F. Liang Guang Lin BDL 113 44 0 23 Oct 2019
Convergence Rates of Variational Inference in Sparse Deep Learning Badr-Eddine Chérief-Abdellatif BDL 83 39 0 09 Aug 2019
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup Sebastian Goldt Madhu S. Advani Andrew M. Saxe Florent Krzakala Lenka Zdeborová MLT 117 145 0 18 Jun 2019
Combining Model and Parameter Uncertainty in Bayesian Neural Networks A. Hubin G. Storvik UQCV BDL 52 11 0 18 Mar 2019
The State of Sparsity in Deep Neural Networks Trevor Gale Erich Elsen Sara Hooker 163 763 0 25 Feb 2019
Sparse DNNs with Improved Adversarial Robustness Yiwen Guo Chao Zhang Changshui Zhang Yurong Chen AAML 74 154 0 23 Oct 2018
A theoretical framework for deep locally connected ReLU network Yuandong Tian PINN 59 10 0 28 Sep 2018
Structured Variational Learning of Bayesian Neural Networks with Horseshoe Priors S. Ghosh Jiayu Yao Finale Doshi-Velez BDL UQCV 50 78 0 13 Jun 2018
Consistency of Variational Bayes Inference for Estimation and Model Selection in Mixtures Badr-Eddine Chérief-Abdellatif Pierre Alquier 99 52 0 14 May 2018
Posterior Concentration for Sparse Deep Learning Nicholas G. Polson Veronika Rockova UQCV BDL 178 90 0 24 Mar 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 269 3,488 0 09 Mar 2018
On Statistical Optimality of Variational Bayes D. Pati A. Bhattacharya Yun Yang 62 64 0 25 Dec 2017
Convergence Rates of Variational Posterior Distributions Fengshuo Zhang Chao Gao 65 105 0 07 Dec 2017
Learning Sparse Neural Networks through $L_0$ Regularization Christos Louizos Max Welling Diederik P. Kingma 439 1,148 0 04 Dec 2017
Sparse-Input Neural Networks for High-dimensional Nonparametric Regression and Classification Jean Feng N. Simon 403 101 0 21 Nov 2017
To prune, or not to prune: exploring the efficacy of pruning for model compression Michael Zhu Suyog Gupta 197 1,281 0 05 Oct 2017
Nonparametric regression using deep neural networks with ReLU activation function Johannes Schmidt-Hieber 238 816 0 22 Aug 2017
Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Science Decebal Constantin Mocanu Elena Mocanu Peter Stone Phuong H. Nguyen M. Gibescu A. Liotta 182 637 0 15 Jul 2017
Model Selection in Bayesian Neural Networks via Horseshoe Priors S. Ghosh Finale Doshi-Velez BDL 67 120 0 29 May 2017
Structured Bayesian Pruning via Log-Normal Multiplicative Noise Kirill Neklyudov Dmitry Molchanov Arsenii Ashukha Dmitry Vetrov BDL 135 189 0 20 May 2017
Variational Dropout Sparsifies Deep Neural Networks Dmitry Molchanov Arsenii Ashukha Dmitry Vetrov BDL 160 831 0 19 Jan 2017
Categorical Reparameterization with Gumbel-Softmax Eric Jang S. Gu Ben Poole BDL 363 5,388 0 03 Nov 2016
The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables Chris J. Maddison A. Mnih Yee Whye Teh BDL 200 2,541 0 02 Nov 2016
Variational Inference: A Review for Statisticians David M. Blei A. Kucukelbir Jon D. McAuliffe BDL 298 4,812 0 04 Jan 2016
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding Song Han Huizi Mao W. Dally 3DGS 263 8,862 0 01 Oct 2015
Weight Uncertainty in Neural Networks Charles Blundell Julien Cornebise Koray Kavukcuoglu Daan Wierstra UQCV BDL 192 1,893 0 20 May 2015
Probabilistic Backpropagation for Scalable Learning of Bayesian Neural Networks José Miguel Hernández-Lobato Ryan P. Adams UQCV BDL 142 945 0 18 Feb 2015
Auto-Encoding Variational Bayes Diederik P. Kingma Max Welling BDL 455 16,922 0 20 Dec 2013
Convergence rates of posterior distributions for noniid observations S. Ghosal A. van der Vaart 397 399 0 03 Aug 2007