v1v2v3v4 (latest)

Stronger generalization bounds for deep nets via a compression approach

14 February 2018

Papers citing "Stronger generalization bounds for deep nets via a compression approach"

50 / 444 papers shown

Title
An Information-Theoretic Framework for Supervised Learning Hong Jun Jeon Yifan Zhu Benjamin Van Roy 92 7 0 01 Mar 2022
Benign Underfitting of Stochastic Gradient Descent Tomer Koren Roi Livni Yishay Mansour Uri Sherman MLT 100 14 0 27 Feb 2022
Adversarial robustness of sparse local Lipschitz predictors Ramchandran Muthukumar Jeremias Sulam AAML 97 13 0 26 Feb 2022
Benefit of Interpolation in Nearest Neighbor Algorithms Yue Xing Qifan Song Guang Cheng 93 31 0 23 Feb 2022
On PAC-Bayesian reconstruction guarantees for VAEs Badr-Eddine Chérief-Abdellatif Yuyang Shi Arnaud Doucet Benjamin Guedj DRL 109 19 0 23 Feb 2022
On Measuring Excess Capacity in Neural Networks Florian Graf Sebastian Zeng Bastian Rieck Marc Niethammer Roland Kwitt 105 10 0 16 Feb 2022
Benign Overfitting in Two-layer Convolutional Neural Networks Yuan Cao Zixiang Chen M. Belkin Quanquan Gu MLT 103 90 0 14 Feb 2022
The Sample Complexity of One-Hidden-Layer Neural Networks Gal Vardi Ohad Shamir Nathan Srebro 74 10 0 13 Feb 2022
Towards Data-Algorithm Dependent Generalization: a Case Study on Overparameterized Linear Regression Jing Xu Jiaye Teng Yang Yuan Andrew Chi-Chih Yao 109 2 0 12 Feb 2022
Support Vectors and Gradient Dynamics of Single-Neuron ReLU Networks Sangmin Lee Byeongsu Sim Jong Chul Ye MLT 57 0 0 11 Feb 2022
Non-Vacuous Generalisation Bounds for Shallow Neural Networks Felix Biggs Benjamin Guedj BDL 106 26 0 03 Feb 2022
Fortuitous Forgetting in Connectionist Networks Hattie Zhou Ankit Vani Hugo Larochelle Aaron Courville CLL 82 45 0 01 Feb 2022
Implicit Regularization Towards Rank Minimization in ReLU Networks Nadav Timor Gal Vardi Ohad Shamir 95 51 0 30 Jan 2022
Sim-to-Lab-to-Real: Safe Reinforcement Learning with Shielding and Generalization Guarantees Kai Hsu Allen Z. Ren D. Nguyen Anirudha Majumdar J. F. Fisac OffRL 107 46 0 20 Jan 2022
On generalization bounds for deep networks based on loss surface implicit regularization Masaaki Imaizumi Johannes Schmidt-Hieber ODL 89 3 0 12 Jan 2022
Generalization Bounds for Stochastic Gradient Langevin Dynamics: A Unified View via Information Leakage Analysis Bingzhe Wu Zhicong Liang Yatao Bian Chaochao Chen Junzhou Huang Yuan Yao 49 1 0 14 Dec 2021
Boosting Active Learning via Improving Test Performance Tianyang Wang Xingjian Li Pengkun Yang Guosheng Hu Xiangrui Zeng Siyu Huang Chengzhong Xu Min Xu 77 33 0 10 Dec 2021
A New Measure of Model Redundancy for Compressed Convolutional Neural Networks Feiqing Huang Yuefeng Si Yao Zheng Guodong Li 69 1 0 09 Dec 2021
Generalization Error Bounds for Iterative Recovery Algorithms Unfolded as Neural Networks Ekkehard Schnoor Arash Behboodi Holger Rauhut 58 14 0 08 Dec 2021
On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons Fangshuo Liao Anastasios Kyrillidis 124 16 0 05 Dec 2021
On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversion Chengyuan Deng Youzuo Lin OOD 65 2 0 28 Nov 2021
Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks Tolga Birdal Aaron Lou Leonidas Guibas Umut cSimcsekli 95 65 0 25 Nov 2021
Predicting the success of Gradient Descent for a particular Dataset-Architecture-Initialization (DAI) Umang Jain H. G. Ramaswamy AI4CE 34 1 0 25 Nov 2021
Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications Darshil Doshi Tianyu He Andrey Gromov 95 10 0 23 Nov 2021
Optimizing Information-theoretical Generalization Bounds via Anisotropic Noise in SGLD Bohan Wang Huishuai Zhang Jieyu Zhang Qi Meng Wei Chen Tie-Yan Liu 58 1 0 26 Oct 2021
In Search of Probeable Generalization Measures Jonathan Jaegerman Khalil Damouni M. M. Ankaralı Konstantinos N. Plataniotis 75 2 0 23 Oct 2021
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks Shuai Zhang Meng Wang Sijia Liu Pin-Yu Chen Jinjun Xiong UQCV MLT 93 13 0 12 Oct 2021
On a Benefit of Mask Language Modeling: Robustness to Simplicity Bias Ting-Rui Chiang 52 4 0 11 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 124 26 0 07 Oct 2021
On the Impact of Stable Ranks in Deep Nets B. Georgiev L. Franken Mayukh Mukherjee Georgios Arvanitidis 71 3 0 05 Oct 2021
Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM) Jie Bu Arka Daw M. Maruf Anuj Karpatne 107 5 0 01 Oct 2021
Ridgeless Interpolation with Shallow ReLU Networks in $1D$ is Nearest Neighbor Curvature Extrapolation and Provably Generalizes on Lipschitz Functions Boris Hanin MLT 78 9 0 27 Sep 2021
Robust Generalization of Quadratic Neural Networks via Function Identification Kan Xu Hamsa Bastani Osbert Bastani OOD 88 8 0 22 Sep 2021
On the Noise Stability and Robustness of Adversarially Trained Networks on NVM Crossbars Chun Tao Deboleena Roy I. Chakraborty Kaushik Roy AAML 86 2 0 19 Sep 2021
Robust Predictable Control Benjamin Eysenbach Ruslan Salakhutdinov Sergey Levine OffRL 93 45 0 07 Sep 2021
Adversarial Parameter Defense by Multi-Step Risk Minimization Zhiyuan Zhang Ruixuan Luo Xuancheng Ren Qi Su Liangyou Li Xu Sun AAML 66 6 0 07 Sep 2021
The Impact of Reinitialization on Generalization in Convolutional Neural Networks Ibrahim Alabdulmohsin Hartmut Maennel Daniel Keysers AI4CE 68 21 0 01 Sep 2021
Ranking Models in Unlabeled New Environments Xiaoxiao Sun Yunzhong Hou Weijian Deng Hongdong Li Liang Zheng OOD 71 9 0 23 Aug 2021
Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers Liam Hodgkinson Umut Simsekli Rajiv Khanna Michael W. Mahoney 93 23 0 02 Aug 2021
Compressing Neural Networks: Towards Determining the Optimal Layer-wise Decomposition Lucas Liebenwein Alaa Maalouf O. Gal Dan Feldman Daniela Rus 75 47 0 23 Jul 2021
Distribution of Classification Margins: Are All Data Equal? Andrzej Banburski Fernanda De La Torre Nishka Pant Ishana Shastri T. Poggio 72 4 0 21 Jul 2021
Noise Stability Regularization for Improving BERT Fine-tuning Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 79 45 0 10 Jul 2021
On Margins and Derandomisation in PAC-Bayes Felix Biggs Benjamin Guedj 98 20 0 08 Jul 2021
Analytic Insights into Structure and Rank of Neural Network Hessian Maps Sidak Pal Singh Gregor Bachmann Thomas Hofmann FAtt 111 37 0 30 Jun 2021
The Values Encoded in Machine Learning Research Abeba Birhane Pratyusha Kalluri Dallas Card William Agnew Ravit Dotan Michelle Bao 99 295 0 29 Jun 2021
Practical Assessment of Generalization Performance Robustness for Deep Networks via Contrastive Examples Xuanyu Wu Xuhong Li Haoyi Xiong Xiao Zhang Siyu Huang Dejing Dou 30 1 0 20 Jun 2021
It's FLAN time! Summing feature-wise latent representations for interpretability An-phi Nguyen María Rodríguez Martínez FAtt 39 0 0 18 Jun 2021
Compression Implies Generalization Allan Grønlund M. Hogsgaard Lior Kamma Kasper Green Larsen MLT AI4CE 38 0 0 15 Jun 2021
Towards Understanding Generalization via Decomposing Excess Risk Dynamics Jiaye Teng Jianhao Ma Yang Yuan 68 4 0 11 Jun 2021
What Does Rotation Prediction Tell Us about Classifier Accuracy under Varying Testing Environments? Weijian Deng Stephen Gould Liang Zheng 103 64 0 10 Jun 2021