Spectrally-normalized margin bounds for neural networks

26 June 2017

Papers citing "Spectrally-normalized margin bounds for neural networks"

50 / 804 papers shown

Title
Predicting the generalization gap in neural networks using topological data analysis Rubén Ballester Xavier Arnal Clemente Carles Casacuberta Meysam Madadi C. Corneanu Sergio Escalera 41 3 0 23 Mar 2022
The activity-weight duality in feed forward neural networks: The geometric determinants of generalization Yu Feng Yuhai Tu MLT 85 14 0 21 Mar 2022
On the Generalization Mystery in Deep Learning S. Chatterjee Piotr Zielinski OOD 28 33 0 18 Mar 2022
Generalization Through The Lens Of Leave-One-Out Error Gregor Bachmann Thomas Hofmann Aurelien Lucchi 67 7 0 07 Mar 2022
Meta Mirror Descent: Optimiser Learning for Fast Convergence Boyan Gao Henry Gouk Haebeom Lee Timothy M. Hospedales 27 6 0 05 Mar 2022
An Information-Theoretic Framework for Supervised Learning Hong Jun Jeon Yifan Zhu Benjamin Van Roy 27 7 0 01 Mar 2022
Adversarial robustness of sparse local Lipschitz predictors Ramchandran Muthukumar Jeremias Sulam AAML 32 13 0 26 Feb 2022
Benefit of Interpolation in Nearest Neighbor Algorithms Yue Xing Qifan Song Guang Cheng 14 28 0 23 Feb 2022
On PAC-Bayesian reconstruction guarantees for VAEs Badr-Eddine Chérief-Abdellatif Yuyang Shi Arnaud Doucet Benjamin Guedj DRL 53 17 0 23 Feb 2022
From Optimization Dynamics to Generalization Bounds via Łojasiewicz Gradient Inequality Fusheng Liu Haizhao Yang Soufiane Hayou Qianxiao Li AI4CE 18 2 0 22 Feb 2022
On the Implicit Bias Towards Minimal Depth of Deep Neural Networks Tomer Galanti Liane Galanti Ido Ben-Shaul 19 12 0 18 Feb 2022
On Measuring Excess Capacity in Neural Networks Florian Graf Sebastian Zeng Bastian Alexander Rieck Marc Niethammer Roland Kwitt 19 10 0 16 Feb 2022
Benign Overfitting in Two-layer Convolutional Neural Networks Yuan Cao Zixiang Chen M. Belkin Quanquan Gu MLT 19 83 0 14 Feb 2022
The Sample Complexity of One-Hidden-Layer Neural Networks Gal Vardi Ohad Shamir Nathan Srebro 22 10 0 13 Feb 2022
Towards Data-Algorithm Dependent Generalization: a Case Study on Overparameterized Linear Regression Jing Xu Jiaye Teng Yang Yuan Andrew Chi-Chih Yao 35 1 0 12 Feb 2022
Failure Prediction with Statistical Guarantees for Vision-Based Robot Control Alec Farid David Snyder Allen Z. Ren Anirudha Majumdar 16 13 0 11 Feb 2022
Support Vectors and Gradient Dynamics of Single-Neuron ReLU Networks Sangmin Lee Byeongsu Sim Jong Chul Ye MLT 24 0 0 11 Feb 2022
Controlling the Complexity and Lipschitz Constant improves polynomial nets Zhenyu Zhu Fabian Latorre Grigorios G. Chrysos V. Cevher 24 10 0 10 Feb 2022
An Exploration of Multicalibration Uniform Convergence Bounds Harrison Rosenberg Robi Bhattacharjee Kassem Fawaz S. Jha 22 1 0 09 Feb 2022
The no-free-lunch theorems of supervised learning T. Sterkenburg Peter Grünwald FedML 24 56 0 09 Feb 2022
Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data Yaoqing Yang Ryan Theisen Liam Hodgkinson Joseph E. Gonzalez Kannan Ramchandran Charles H. Martin Michael W. Mahoney 94 17 0 06 Feb 2022
Non-Vacuous Generalisation Bounds for Shallow Neural Networks Felix Biggs Benjamin Guedj BDL 30 26 0 03 Feb 2022
Approximation bounds for norm constrained neural networks with applications to regression and GANs Yuling Jiao Yang Wang Yunfei Yang 36 19 0 24 Jan 2022
Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions Mojtaba Sahraee-Ardakan M. Emami Parthe Pandit S. Rangan A. Fletcher 41 9 0 20 Jan 2022
ExpertNet: A Symbiosis of Classification and Clustering Shivin Srivastava Kenji Kawaguchi Vaibhav Rajan 14 1 0 17 Jan 2022
Neighborhood Region Smoothing Regularization for Finding Flat Minima In Deep Neural Networks Yang Zhao Hao Zhang 22 1 0 16 Jan 2022
On generalization bounds for deep networks based on loss surface implicit regularization Masaaki Imaizumi Johannes Schmidt-Hieber ODL 34 3 0 12 Jan 2022
Leveraging Unlabeled Data to Predict Out-of-Distribution Performance Saurabh Garg Sivaraman Balakrishnan Zachary Chase Lipton Behnam Neyshabur Hanie Sedghi OODD OOD 50 125 0 11 Jan 2022
Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks Shaun Li AI4CE 46 0 0 03 Jan 2022
On the Role of Neural Collapse in Transfer Learning Tomer Galanti András Gyorgy Marcus Hutter SSL 21 87 0 30 Dec 2021
Depth and Feature Learning are Provably Beneficial for Neural Network Discriminators Carles Domingo-Enrich MLT MDE 31 0 0 27 Dec 2021
Self-Ensembling GAN for Cross-Domain Semantic Segmentation Yonghao Xu Fengxiang He Bo Du Dacheng Tao Liangpei Zhang GAN 38 15 0 15 Dec 2021
A New Measure of Model Redundancy for Compressed Convolutional Neural Networks Feiqing Huang Yuefeng Si Yao Zheng Guodong Li 39 1 0 09 Dec 2021
Effective dimension of machine learning models Amira Abbas David Sutter Alessio Figalli Stefan Woerner 82 17 0 09 Dec 2021
Generalization Error Bounds for Iterative Recovery Algorithms Unfolded as Neural Networks Ekkehard Schnoor Arash Behboodi Holger Rauhut 24 13 0 08 Dec 2021
Spectral Complexity-scaled Generalization Bound of Complex-valued Neural Networks Haowen Chen Fengxiang He Shiye Lei Dacheng Tao 18 0 0 07 Dec 2021
On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons Fangshuo Liao Anastasios Kyrillidis 46 16 0 05 Dec 2021
Learning with Noisy Labels by Efficient Transition Matrix Estimation to Combat Label Miscorrection Seong Min Kye Kwanghee Choi Joonyoung Yi Buru Chang NoLa 35 15 0 29 Nov 2021
On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversion Chengyuan Deng Youzuo Lin OOD 25 2 0 28 Nov 2021
Generalization Performance of Empirical Risk Minimization on Over-parameterized Deep ReLU Nets Shao-Bo Lin Yao Wang Ding-Xuan Zhou ODL 18 6 0 28 Nov 2021
Stronger Generalization Guarantees for Robot Learning by Combining Generative Models and Real-World Data Abhinav Agarwal Sushant Veer Allen Z. Ren Anirudha Majumdar 28 1 0 16 Nov 2021
Understanding the Generalization Benefit of Model Invariance from a Data Perspective Sicheng Zhu Bang An Furong Huang 24 25 0 10 Nov 2021
Information-Theoretic Bayes Risk Lower Bounds for Realizable Models M. Nokleby Ahmad Beirami 59 1 0 08 Nov 2021
Improved Regularization and Robustness for Fine-tuning in Neural Networks Dongyue Li Hongyang R. Zhang NoLa 55 54 0 08 Nov 2021
Adversarial Robustness with Semi-Infinite Constrained Learning Alexander Robey Luiz F. O. Chamon George J. Pappas Hamed Hassani Alejandro Ribeiro AAML OOD 118 42 0 29 Oct 2021
Does the Data Induce Capacity Control in Deep Learning? Rubing Yang Jialin Mao Pratik Chaudhari 35 15 0 27 Oct 2021
Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias Kaifeng Lyu Zhiyuan Li Runzhe Wang Sanjeev Arora MLT 39 69 0 26 Oct 2021
A Dynamical System Perspective for Lipschitz Neural Networks Laurent Meunier Blaise Delattre Alexandre Araujo A. Allauzen 45 53 0 25 Oct 2021
In Search of Probeable Generalization Measures Jonathan Jaegerman Khalil Damouni M. M. Ankaralı Konstantinos N. Plataniotis 27 2 0 23 Oct 2021
Inductive Biases and Variable Creation in Self-Attention Mechanisms Benjamin L. Edelman Surbhi Goel Sham Kakade Cyril Zhang 27 117 0 19 Oct 2021