v1v2 (latest)

Spectrally-normalized margin bounds for neural networks

26 June 2017

Papers citing "Spectrally-normalized margin bounds for neural networks"

50 / 811 papers shown

Title
Information-Theoretic Bayes Risk Lower Bounds for Realizable Models M. Nokleby Ahmad Beirami 88 1 0 08 Nov 2021
Improved Regularization and Robustness for Fine-tuning in Neural Networks Dongyue Li Hongyang R. Zhang NoLa 95 56 0 08 Nov 2021
Adversarial Robustness with Semi-Infinite Constrained Learning Alexander Robey Luiz F. O. Chamon George J. Pappas Hamed Hassani Alejandro Ribeiro AAML OOD 175 46 0 29 Oct 2021
Does the Data Induce Capacity Control in Deep Learning? Rubing Yang Jialin Mao Pratik Chaudhari 124 16 0 27 Oct 2021
Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias Kaifeng Lyu Zhiyuan Li Runzhe Wang Sanjeev Arora MLT 110 76 0 26 Oct 2021
A Dynamical System Perspective for Lipschitz Neural Networks Laurent Meunier Blaise Delattre Alexandre Araujo A. Allauzen 128 56 0 25 Oct 2021
In Search of Probeable Generalization Measures Jonathan Jaegerman Khalil Damouni M. M. Ankaralı Konstantinos N. Plataniotis 61 2 0 23 Oct 2021
Inductive Biases and Variable Creation in Self-Attention Mechanisms Benjamin L. Edelman Surbhi Goel Sham Kakade Cyril Zhang 102 125 0 19 Oct 2021
Single Layer Predictive Normalized Maximum Likelihood for Out-of-Distribution Detection Koby Bibas M. Feder Tal Hassner OODD 79 24 0 18 Oct 2021
Well-classified Examples are Underestimated in Classification with Deep Neural Networks Guangxiang Zhao Wenkai Yang Xuancheng Ren Lei Li Hao Sun Xu Sun 83 15 0 13 Oct 2021
Adversarial Unlearning of Backdoors via Implicit Hypergradient Yi Zeng Si-An Chen Won Park Z. Morley Mao Ming Jin R. Jia AAML 153 178 0 07 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 124 26 0 07 Oct 2021
VC dimension of partially quantized neural networks in the overparametrized regime Yutong Wang Clayton D. Scott 81 1 0 06 Oct 2021
On the Impact of Stable Ranks in Deep Nets B. Georgiev L. Franken Mayukh Mukherjee Georgios Arvanitidis 62 3 0 05 Oct 2021
Exploring the Limits of Large Scale Pre-training Samira Abnar Mostafa Dehghani Behnam Neyshabur Hanie Sedghi AI4CE 116 119 0 05 Oct 2021
A Theoretical Overview of Neural Contraction Metrics for Learning-based Control with Guaranteed Stability Hiroyasu Tsukamoto Soon-Jo Chung Jean-Jacques E. Slotine Chuchu Fan 55 11 0 02 Oct 2021
Ridgeless Interpolation with Shallow ReLU Networks in $1D$ is Nearest Neighbor Curvature Extrapolation and Provably Generalizes on Lipschitz Functions Boris Hanin MLT 78 9 0 27 Sep 2021
Deep Exploration for Recommendation Systems Zheqing Zhu Benjamin Van Roy 108 11 0 26 Sep 2021
When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization? Zheyuan Hu Ameya Dilip Jagtap George Karniadakis Kenji Kawaguchi AI4CE PINN 89 88 0 20 Sep 2021
Inferential Wasserstein Generative Adversarial Networks Yao Chen Qingyi Gao Xiao Wang GAN 182 23 0 13 Sep 2021
A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning Yehuda Dar Vidya Muthukumar Richard G. Baraniuk 117 72 0 06 Sep 2021
The Impact of Reinitialization on Generalization in Convolutional Neural Networks Ibrahim Alabdulmohsin Hartmut Maennel Daniel Keysers AI4CE 61 21 0 01 Sep 2021
Lipschitz Continuity Guided Knowledge Distillation Yuzhang Shang Bin Duan Ziliang Zong Liqiang Nie Yan Yan 70 29 0 29 Aug 2021
A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective? Hiroaki Mikami Kenji Fukumizu Shogo Murai Shuji Suzuki Yuta Kikuchi Taiji Suzuki S. Maeda Kohei Hayashi 92 12 0 25 Aug 2021
Logit Attenuating Weight Normalization Aman Gupta R. Ramanath Jun Shi Anika Ramachandran Sirou Zhou Mingzhou Zhou S. Keerthi 75 1 0 12 Aug 2021
Fairness Properties of Face Recognition and Obfuscation Systems Harrison Rosenberg Brian Tang Kassem Fawaz S. Jha PICV 71 14 0 05 Aug 2021
Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100 Sahil Singla Surbhi Singla Soheil Feizi AAML 90 58 0 05 Aug 2021
Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers Liam Hodgkinson Umut Simsekli Rajiv Khanna Michael W. Mahoney 77 23 0 02 Aug 2021
Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers Colin Wei Yining Chen Tengyu Ma 77 92 0 28 Jul 2021
Exploring Sequence Feature Alignment for Domain Adaptive Detection Transformers Wen Wang Yang Cao Jing Zhang Fengxiang He Zhengjun Zha Yonggang Wen Dacheng Tao ViT 113 96 0 27 Jul 2021
Statistical Estimation from Dependent Data Y. Dagan Anthimos Vardis Kandiros Nishanth Dikkala Surbhi Goel C. Daskalakis 39 8 0 20 Jul 2021
A Theory of PAC Learnability of Partial Concept Classes N. Alon Steve Hanneke R. Holzman Shay Moran 77 54 0 18 Jul 2021
On the expressivity of bi-Lipschitz normalizing flows Alexandre Verine Benjamin Négrevergne F. Rossi Y. Chevaleyre TPM 92 17 0 15 Jul 2021
Noise Stability Regularization for Improving BERT Fine-tuning Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 79 45 0 10 Jul 2021
On Margins and Derandomisation in PAC-Bayes Felix Biggs Benjamin Guedj 93 20 0 08 Jul 2021
Learning an Explicit Hyperparameter Prediction Function Conditioned on Tasks Jun Shu Deyu Meng Zongben Xu 79 8 0 06 Jul 2021
A study of CNN capacity applied to Left Venticle Segmentation in Cardiac MRI Marcelo A. F. Toledo Daniel M. Lima J. Krieger Marco A. Gutierrez 61 2 0 03 Jul 2021
Fast Margin Maximization via Dual Acceleration Ziwei Ji Nathan Srebro Matus Telgarsky 67 39 0 01 Jul 2021
Analytic Insights into Structure and Rank of Neural Network Hessian Maps Sidak Pal Singh Gregor Bachmann Thomas Hofmann FAtt 101 37 0 30 Jun 2021
Understanding Adversarial Examples Through Deep Neural Network's Response Surface and Uncertainty Regions Juan Shu B. Xi Charles A. Kamhoua AAML 100 0 0 30 Jun 2021
Assessing Generalization of SGD via Disagreement Yiding Jiang Vaishnavh Nagarajan Christina Baek J. Zico Kolter 109 115 0 25 Jun 2021
Task-Driven Detection of Distribution Shifts with Statistical Guarantees for Robot Learning Alec Farid Sushant Veer Divya Pachisia Anirudha Majumdar OODD 54 1 0 25 Jun 2021
Practical Assessment of Generalization Performance Robustness for Deep Networks via Contrastive Examples Xuanyu Wu Xuhong Li Haoyi Xiong Xiao Zhang Siyu Huang Dejing Dou 23 1 0 20 Jun 2021
Spoofing Generalization: When Can't You Trust Proprietary Models? Ankur Moitra Elchanan Mossel Colin Sandon FedML 38 2 0 15 Jun 2021
Compression Implies Generalization Allan Grønlund M. Hogsgaard Lior Kamma Kasper Green Larsen MLT AI4CE 23 0 0 15 Jun 2021
Towards Understanding Generalization via Decomposing Excess Risk Dynamics Jiaye Teng Jianhao Ma Yang Yuan 68 4 0 11 Jun 2021
Early-stopped neural networks are consistent Ziwei Ji Justin D. Li Matus Telgarsky 85 37 0 10 Jun 2021
Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space Sho Sonoda Isao Ishikawa Masahiro Ikeda BDL 51 9 0 09 Jun 2021
LEADS: Learning Dynamical Systems that Generalize Across Environments Yuan Yin Ibrahim Ayed Emmanuel de Bézenac Nicolas Baskiotis Patrick Gallinari OOD 75 34 0 08 Jun 2021
What Makes Multi-modal Learning Better than Single (Provably) Yu Huang Chenzhuang Du Zihui Xue Xuanyao Chen Hang Zhao Longbo Huang 100 268 0 08 Jun 2021