Stronger generalization bounds for deep nets via a compression approach

14 February 2018

Papers citing "Stronger generalization bounds for deep nets via a compression approach"

50 / 440 papers shown

Title
Benign Overfitting in Two-layer Convolutional Neural Networks Yuan Cao Zixiang Chen M. Belkin Quanquan Gu MLT 19 85 0 14 Feb 2022
The Sample Complexity of One-Hidden-Layer Neural Networks Gal Vardi Ohad Shamir Nathan Srebro 22 10 0 13 Feb 2022
Towards Data-Algorithm Dependent Generalization: a Case Study on Overparameterized Linear Regression Jing Xu Jiaye Teng Yang Yuan Andrew Chi-Chih Yao 35 1 0 12 Feb 2022
Support Vectors and Gradient Dynamics of Single-Neuron ReLU Networks Sangmin Lee Byeongsu Sim Jong Chul Ye MLT 24 0 0 11 Feb 2022
Non-Vacuous Generalisation Bounds for Shallow Neural Networks Felix Biggs Benjamin Guedj BDL 30 26 0 03 Feb 2022
Fortuitous Forgetting in Connectionist Networks Hattie Zhou Ankit Vani Hugo Larochelle Aaron Courville CLL 16 42 0 01 Feb 2022
Implicit Regularization Towards Rank Minimization in ReLU Networks Nadav Timor Gal Vardi Ohad Shamir 39 49 0 30 Jan 2022
Sim-to-Lab-to-Real: Safe Reinforcement Learning with Shielding and Generalization Guarantees Kai Hsu Allen Z. Ren D. Nguyen Anirudha Majumdar J. F. Fisac OffRL 26 41 0 20 Jan 2022
On generalization bounds for deep networks based on loss surface implicit regularization Masaaki Imaizumi Johannes Schmidt-Hieber ODL 34 3 0 12 Jan 2022
Generalization Bounds for Stochastic Gradient Langevin Dynamics: A Unified View via Information Leakage Analysis Bingzhe Wu Zhicong Liang Yatao Bian Chaochao Chen Junzhou Huang Yuan Yao 29 1 0 14 Dec 2021
Boosting Active Learning via Improving Test Performance Tianyang Wang Xingjian Li Pengkun Yang Guosheng Hu Xiangrui Zeng Siyu Huang Chengzhong Xu Min Xu 33 33 0 10 Dec 2021
A New Measure of Model Redundancy for Compressed Convolutional Neural Networks Feiqing Huang Yuefeng Si Yao Zheng Guodong Li 39 1 0 09 Dec 2021
Generalization Error Bounds for Iterative Recovery Algorithms Unfolded as Neural Networks Ekkehard Schnoor Arash Behboodi Holger Rauhut 24 13 0 08 Dec 2021
On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons Fangshuo Liao Anastasios Kyrillidis 59 16 0 05 Dec 2021
On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversion Chengyuan Deng Youzuo Lin OOD 28 2 0 28 Nov 2021
Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks Tolga Birdal Aaron Lou Leonidas J. Guibas Umut cSimcsekli 32 61 0 25 Nov 2021
Predicting the success of Gradient Descent for a particular Dataset-Architecture-Initialization (DAI) Umang Jain H. G. Ramaswamy AI4CE 21 1 0 25 Nov 2021
Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications Darshil Doshi Tianyu He Andrey Gromov 30 8 0 23 Nov 2021
Optimizing Information-theoretical Generalization Bounds via Anisotropic Noise in SGLD Bohan Wang Huishuai Zhang Jieyu Zhang Qi Meng Wei Chen Tie-Yan Liu 14 1 0 26 Oct 2021
In Search of Probeable Generalization Measures Jonathan Jaegerman Khalil Damouni M. M. Ankaralı Konstantinos N. Plataniotis 32 2 0 23 Oct 2021
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks Shuai Zhang Meng Wang Sijia Liu Pin-Yu Chen Jinjun Xiong UQCV MLT 31 13 0 12 Oct 2021
On a Benefit of Mask Language Modeling: Robustness to Simplicity Bias Ting-Rui Chiang 38 4 0 11 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 39 22 0 07 Oct 2021
On the Impact of Stable Ranks in Deep Nets B. Georgiev L. Franken Mayukh Mukherjee Georgios Arvanitidis 23 3 0 05 Oct 2021
Learning Compact Representations of Neural Networks using DiscriminAtive Masking (DAM) Jie Bu Arka Daw M. Maruf Anuj Karpatne 43 5 0 01 Oct 2021
Ridgeless Interpolation with Shallow ReLU Networks in $1D$ is Nearest Neighbor Curvature Extrapolation and Provably Generalizes on Lipschitz Functions Boris Hanin MLT 40 9 0 27 Sep 2021
Robust Generalization of Quadratic Neural Networks via Function Identification Kan Xu Hamsa Bastani Osbert Bastani OOD 36 8 0 22 Sep 2021
On the Noise Stability and Robustness of Adversarially Trained Networks on NVM Crossbars Chun Tao Deboleena Roy I. Chakraborty Kaushik Roy AAML 37 2 0 19 Sep 2021
Robust Predictable Control Benjamin Eysenbach Ruslan Salakhutdinov Sergey Levine OffRL 32 44 0 07 Sep 2021
Adversarial Parameter Defense by Multi-Step Risk Minimization Zhiyuan Zhang Ruixuan Luo Xuancheng Ren Qi Su Liangyou Li Xu Sun AAML 25 6 0 07 Sep 2021
The Impact of Reinitialization on Generalization in Convolutional Neural Networks Ibrahim M. Alabdulmohsin Hartmut Maennel Daniel Keysers AI4CE 34 20 0 01 Sep 2021
Ranking Models in Unlabeled New Environments Xiaoxiao Sun Yunzhong Hou Weijian Deng Hongdong Li Liang Zheng OOD 21 9 0 23 Aug 2021
Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers Liam Hodgkinson Umut Simsekli Rajiv Khanna Michael W. Mahoney 30 20 0 02 Aug 2021
Compressing Neural Networks: Towards Determining the Optimal Layer-wise Decomposition Lucas Liebenwein Alaa Maalouf O. Gal Dan Feldman Daniela Rus 40 46 0 23 Jul 2021
Distribution of Classification Margins: Are All Data Equal? Andrzej Banburski Fernanda De La Torre Nishka Pant Ishana Shastri T. Poggio 33 4 0 21 Jul 2021
Noise Stability Regularization for Improving BERT Fine-tuning Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 19 44 0 10 Jul 2021
On Margins and Derandomisation in PAC-Bayes Felix Biggs Benjamin Guedj 28 20 0 08 Jul 2021
Analytic Insights into Structure and Rank of Neural Network Hessian Maps Sidak Pal Singh Gregor Bachmann Thomas Hofmann FAtt 28 34 0 30 Jun 2021
The Values Encoded in Machine Learning Research Abeba Birhane Pratyusha Kalluri Dallas Card William Agnew Ravit Dotan Michelle Bao 41 275 0 29 Jun 2021
Practical Assessment of Generalization Performance Robustness for Deep Networks via Contrastive Examples Xuanyu Wu Xuhong Li Haoyi Xiong Xiao Zhang Siyu Huang Dejing Dou 21 1 0 20 Jun 2021
It's FLAN time! Summing feature-wise latent representations for interpretability An-phi Nguyen María Rodríguez Martínez FAtt 18 0 0 18 Jun 2021
Compression Implies Generalization Allan Grønlund M. Hogsgaard Lior Kamma Kasper Green Larsen MLT AI4CE 14 0 0 15 Jun 2021
Towards Understanding Generalization via Decomposing Excess Risk Dynamics Jiaye Teng Jianhao Ma Yang Yuan 29 4 0 11 Jun 2021
What Does Rotation Prediction Tell Us about Classifier Accuracy under Varying Testing Environments? Weijian Deng Stephen Gould Liang Zheng 39 63 0 10 Jun 2021
Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms A. Camuto George Deligiannidis Murat A. Erdogdu Mert Gurbuzbalaban Umut cSimcsekli Lingjiong Zhu 33 29 0 09 Jun 2021
Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space Sho Sonoda Isao Ishikawa Masahiro Ikeda BDL 22 9 0 09 Jun 2021
What training reveals about neural network complexity Andreas Loukas Marinos Poiitis Stefanie Jegelka 28 11 0 08 Jun 2021
The Randomness of Input Data Spaces is an A Priori Predictor for Generalization Martin Briesch Dominik Sobania Franz Rothlauf UQCV 35 1 0 08 Jun 2021
Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks Melih Barsbey Romain Chor Murat A. Erdogdu Gaël Richard Umut Simsekli 22 41 0 07 Jun 2021
Measuring Generalization with Optimal Transport Ching-Yao Chuang Youssef Mroueh Kristjan Greenewald Antonio Torralba Stefanie Jegelka OT 46 25 0 07 Jun 2021