Stronger generalization bounds for deep nets via a compression approach

14 February 2018

Papers citing "Stronger generalization bounds for deep nets via a compression approach"

50 / 440 papers shown

Title
A PAC-Bayesian Generalization Bound for Equivariant Networks Arash Behboodi Gabriele Cesa Taco S. Cohen 58 17 0 24 Oct 2022
Evolution of Neural Tangent Kernels under Benign and Adversarial Training Noel Loo Ramin Hasani Alexander Amini Daniela Rus AAML 36 13 0 21 Oct 2022
GA-SAM: Gradient-Strength based Adaptive Sharpness-Aware Minimization for Improved Generalization Zhiyuan Zhang Ruixuan Luo Qi Su Xueting Sun 29 11 0 13 Oct 2022
Continual task learning in natural and artificial agents Timo Flesch Andrew M. Saxe Christopher Summerfield CLL 43 24 0 10 Oct 2022
Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel Sungyub Kim Si-hun Park Kyungsu Kim Eunho Yang BDL 32 4 0 30 Sep 2022
Neural Networks Efficiently Learn Low-Dimensional Representations with SGD Alireza Mousavi-Hosseini Sejun Park M. Girotti Ioannis Mitliagkas Murat A. Erdogdu MLT 324 48 0 29 Sep 2022
Why neural networks find simple solutions: the many regularizers of geometric complexity Benoit Dherin Michael Munn M. Rosca David Barrett 57 31 0 27 Sep 2022
Approximate Description Length, Covering Numbers, and VC Dimension Amit Daniely Gal Katzhendler 16 0 0 26 Sep 2022
Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks Yunwen Lei Rong Jin Yiming Ying MLT 40 18 0 19 Sep 2022
Pruning Neural Networks via Coresets and Convex Geometry: Towards No Assumptions M. Tukan Loay Mualem Alaa Maalouf 3DPC 53 22 0 18 Sep 2022
Improving Self-supervised Learning for Out-of-distribution Task via Auxiliary Classifier Harshita Boonlia T. Dam Md Meftahul Ferdaus S. Anavatti Ankan Mullick OODD 16 4 0 07 Sep 2022
Overparameterization from Computational Constraints Sanjam Garg S. Jha Saeed Mahloujifar Mohammad Mahmoody Mingyuan Wang 28 1 0 27 Aug 2022
On the generalization of learning algorithms that do not converge N. Chandramoorthy Andreas Loukas Khashayar Gatmiry Stefanie Jegelka MLT 19 11 0 16 Aug 2022
On the Strong Correlation Between Model Invariance and Generalization Weijian Deng Stephen Gould Liang Zheng OOD 32 16 0 14 Jul 2022
A law of adversarial risk, interpolation, and label noise Daniel Paleka Amartya Sanyal NoLa AAML 20 9 0 08 Jul 2022
Training Patch Analysis and Mining Skills for Image Restoration Deep Neural Networks Jae Woong Soh N. Cho 12 0 0 03 Jul 2022
Max-Margin Works while Large Margin Fails: Generalization without Uniform Convergence Margalit Glasgow Colin Wei Mary Wootters Tengyu Ma 38 5 0 16 Jun 2022
Benefits of Additive Noise in Composing Classes with Bounded Capacity A. F. Pour H. Ashtiani 33 3 0 14 Jun 2022
Zeroth-Order Topological Insights into Iterative Magnitude Pruning Aishwarya H. Balwani J. Krzyston 34 2 0 14 Jun 2022
Improving Pre-trained Language Model Fine-tuning with Noise Stability Regularization Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 38 15 0 12 Jun 2022
A Theoretical Understanding of Neural Network Compression from Sparse Linear Approximation Wenjing Yang G. Wang Jie Ding Yuhong Yang MLT 41 7 0 11 Jun 2022
Fisher SAM: Information Geometry and Sharpness Aware Minimisation Minyoung Kim Da Li S. Hu Timothy M. Hospedales AAML 27 70 0 10 Jun 2022
Trajectory-dependent Generalization Bounds for Deep Neural Networks via Fractional Brownian Motion Chengli Tan Jiang Zhang Junmin Liu 43 1 0 09 Jun 2022
Generalization Error Bounds for Deep Neural Networks Trained by SGD Mingze Wang Chao Ma 6 14 0 07 Jun 2022
Robust Fine-Tuning of Deep Neural Networks with Hessian-based Generalization Guarantees Haotian Ju Dongyue Li Hongyang R. Zhang 45 28 0 06 Jun 2022
Rate-Distortion Theoretic Bounds on Generalization Error for Distributed Learning Romain Chor Abdellatif Zaidi Milad Sefidgaran FedML 37 15 0 06 Jun 2022
Long-Tailed Learning Requires Feature Learning T. Laurent J. V. Brecht Xavier Bresson VLM 16 1 0 29 May 2022
Sharpness-Aware Training for Free Jiawei Du Daquan Zhou Jiashi Feng Vincent Y. F. Tan Qiufeng Wang AAML 33 92 0 27 May 2022
Generalization Bounds for Gradient Methods via Discrete and Continuous Prior Jun Yu Li Xu Luo Jian Li 27 4 0 27 May 2022
Learning to Reason with Neural Networks: Generalization, Unseen Data and Boolean Measures Emmanuel Abbe Samy Bengio Elisabetta Cornacchia Jon M. Kleinberg Aryo Lotfi M. Raghu Chiyuan Zhang MLT 16 10 0 26 May 2022
Deep Active Learning with Noise Stability Xingjian Li Pengkun Yang Mingkun Xu Xueying Zhan Tianyang Wang Dejing Dou Chengzhong Xu UQCV 32 12 0 26 May 2022
A Convergence Theory for Over-parameterized Variational Quantum Eigensolvers Xuchen You Shouvanik Chakrabarti Xiaodi Wu 63 34 0 25 May 2022
Towards Size-Independent Generalization Bounds for Deep Operator Nets Pulkit Gopalani Sayar Karmakar Dibyakanti Kumar Anirbit Mukherjee AI4CE 24 5 0 23 May 2022
Deep neural networks with dependent weights: Gaussian Process mixture limit, heavy tails, sparsity and compressibility Hoileong Lee Fadhel Ayed Paul Jung Juho Lee Hongseok Yang François Caron 46 10 0 17 May 2022
Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a Survey Paul Wimmer Jens Mehnert A. P. Condurache DD 34 20 0 17 May 2022
On the Generalization Mystery in Deep Learning S. Chatterjee Piotr Zielinski OOD 28 33 0 18 Mar 2022
Error estimates for physics informed neural networks approximating the Navier-Stokes equations Tim De Ryck Ameya Dilip Jagtap S. Mishra PINN 49 115 0 17 Mar 2022
Confidence Dimension for Deep Learning based on Hoeffding Inequality and Relative Evaluation Runqi Wang Linlin Yang Baochang Zhang Wentao Zhu David Doermann Guodong Guo 29 1 0 17 Mar 2022
Approximability and Generalisation A. J. Turner Ata Kabán 33 0 0 15 Mar 2022
projUNN: efficient method for training deep networks with unitary matrices B. Kiani Randall Balestriero Yann LeCun S. Lloyd 48 32 0 10 Mar 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 44 48 0 09 Mar 2022
Generalization Through The Lens Of Leave-One-Out Error Gregor Bachmann Thomas Hofmann Aurelien Lucchi 67 7 0 07 Mar 2022
Rate-Distortion Theoretic Generalization Bounds for Stochastic Learning Algorithms Romain Chor A. Gohari Gaël Richard Umut Simsekli 25 23 0 04 Mar 2022
Adaptive Discriminative Regularization for Visual Classification Qingsong Zhao Yi Wang Shuguang Dou Chen Gong Yin Wang Cairong Zhao 24 0 0 02 Mar 2022
An Information-Theoretic Framework for Supervised Learning Hong Jun Jeon Yifan Zhu Benjamin Van Roy 27 7 0 01 Mar 2022
Benign Underfitting of Stochastic Gradient Descent Tomer Koren Roi Livni Yishay Mansour Uri Sherman MLT 22 13 0 27 Feb 2022
Adversarial robustness of sparse local Lipschitz predictors Ramchandran Muthukumar Jeremias Sulam AAML 34 13 0 26 Feb 2022
Benefit of Interpolation in Nearest Neighbor Algorithms Yue Xing Qifan Song Guang Cheng 17 28 0 23 Feb 2022
On PAC-Bayesian reconstruction guarantees for VAEs Badr-Eddine Chérief-Abdellatif Yuyang Shi Arnaud Doucet Benjamin Guedj DRL 53 17 0 23 Feb 2022
On Measuring Excess Capacity in Neural Networks Florian Graf Sebastian Zeng Bastian Alexander Rieck Marc Niethammer Roland Kwitt 24 10 0 16 Feb 2022