Spectrally-normalized margin bounds for neural networks

26 June 2017

Papers citing "Spectrally-normalized margin bounds for neural networks"

50 / 804 papers shown

Title
Single Layer Predictive Normalized Maximum Likelihood for Out-of-Distribution Detection Koby Bibas M. Feder Tal Hassner OODD 39 24 0 18 Oct 2021
Well-classified Examples are Underestimated in Classification with Deep Neural Networks Guangxiang Zhao Wenkai Yang Xuancheng Ren Lei Li Yunfang Wu Xu Sun 25 15 0 13 Oct 2021
Adversarial Unlearning of Backdoors via Implicit Hypergradient Yi Zeng Si-An Chen Won Park Z. Morley Mao Ming Jin R. Jia AAML 28 172 0 07 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 37 22 0 07 Oct 2021
VC dimension of partially quantized neural networks in the overparametrized regime Yutong Wang Clayton D. Scott 25 1 0 06 Oct 2021
On the Impact of Stable Ranks in Deep Nets B. Georgiev L. Franken Mayukh Mukherjee Georgios Arvanitidis 21 3 0 05 Oct 2021
Exploring the Limits of Large Scale Pre-training Samira Abnar Mostafa Dehghani Behnam Neyshabur Hanie Sedghi AI4CE 60 114 0 05 Oct 2021
A Theoretical Overview of Neural Contraction Metrics for Learning-based Control with Guaranteed Stability Hiroyasu Tsukamoto Soon-Jo Chung Jean-Jacques E. Slotine Chuchu Fan 24 10 0 02 Oct 2021
Ridgeless Interpolation with Shallow ReLU Networks in $1D$ is Nearest Neighbor Curvature Extrapolation and Provably Generalizes on Lipschitz Functions Boris Hanin MLT 38 9 0 27 Sep 2021
Deep Exploration for Recommendation Systems Zheqing Zhu Benjamin Van Roy 32 11 0 26 Sep 2021
When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization? Zheyuan Hu Ameya Dilip Jagtap George Karniadakis Kenji Kawaguchi AI4CE PINN 30 83 0 20 Sep 2021
Inferential Wasserstein Generative Adversarial Networks Yao Chen Qingyi Gao Xiao Wang GAN 108 20 0 13 Sep 2021
A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning Yehuda Dar Vidya Muthukumar Richard G. Baraniuk 36 71 0 06 Sep 2021
The Impact of Reinitialization on Generalization in Convolutional Neural Networks Ibrahim M. Alabdulmohsin Hartmut Maennel Daniel Keysers AI4CE 34 20 0 01 Sep 2021
Lipschitz Continuity Guided Knowledge Distillation Yuzhang Shang Bin Duan Ziliang Zong Liqiang Nie Yan Yan 22 29 0 29 Aug 2021
A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective? Hiroaki Mikami Kenji Fukumizu Shogo Murai Shuji Suzuki Yuta Kikuchi Taiji Suzuki S. Maeda Kohei Hayashi 40 12 0 25 Aug 2021
Logit Attenuating Weight Normalization Aman Gupta R. Ramanath Jun Shi Anika Ramachandran Sirou Zhou Mingzhou Zhou S. Keerthi 40 1 0 12 Aug 2021
Fairness Properties of Face Recognition and Obfuscation Systems Harrison Rosenberg Brian Tang Kassem Fawaz S. Jha PICV 13 14 0 05 Aug 2021
Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100 Sahil Singla Surbhi Singla S. Feizi AAML 38 55 0 05 Aug 2021
Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers Liam Hodgkinson Umut Simsekli Rajiv Khanna Michael W. Mahoney 24 20 0 02 Aug 2021
Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers Colin Wei Yining Chen Tengyu Ma 21 88 0 28 Jul 2021
Exploring Sequence Feature Alignment for Domain Adaptive Detection Transformers Wen Wang Yang Cao Jing Zhang Fengxiang He Zhengjun Zha Yonggang Wen Dacheng Tao ViT 29 94 0 27 Jul 2021
Statistical Estimation from Dependent Data Y. Dagan Anthimos Vardis Kandiros Nishanth Dikkala Surbhi Goel C. Daskalakis 6 8 0 20 Jul 2021
A Theory of PAC Learnability of Partial Concept Classes N. Alon Steve Hanneke R. Holzman Shay Moran 28 50 0 18 Jul 2021
On the expressivity of bi-Lipschitz normalizing flows Alexandre Verine Benjamin Négrevergne F. Rossi Y. Chevaleyre TPM 23 17 0 15 Jul 2021
Noise Stability Regularization for Improving BERT Fine-tuning Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 19 43 0 10 Jul 2021
On Margins and Derandomisation in PAC-Bayes Felix Biggs Benjamin Guedj 28 20 0 08 Jul 2021
Learning an Explicit Hyperparameter Prediction Function Conditioned on Tasks Jun Shu Deyu Meng Zongben Xu 32 6 0 06 Jul 2021
A study of CNN capacity applied to Left Venticle Segmentation in Cardiac MRI Marcelo A. F. Toledo Daniel M. Lima J. Krieger Marco A. Gutierrez 34 2 0 03 Jul 2021
Fast Margin Maximization via Dual Acceleration Ziwei Ji Nathan Srebro Matus Telgarsky 23 36 0 01 Jul 2021
Analytic Insights into Structure and Rank of Neural Network Hessian Maps Sidak Pal Singh Gregor Bachmann Thomas Hofmann FAtt 28 33 0 30 Jun 2021
Understanding Adversarial Examples Through Deep Neural Network's Response Surface and Uncertainty Regions Juan Shu B. Xi Charles A. Kamhoua AAML 19 0 0 30 Jun 2021
Assessing Generalization of SGD via Disagreement Yiding Jiang Vaishnavh Nagarajan Christina Baek J. Zico Kolter 67 109 0 25 Jun 2021
Task-Driven Detection of Distribution Shifts with Statistical Guarantees for Robot Learning Alec Farid Sushant Veer Divya Pachisia Anirudha Majumdar OODD 38 1 0 25 Jun 2021
Practical Assessment of Generalization Performance Robustness for Deep Networks via Contrastive Examples Xuanyu Wu Xuhong Li Haoyi Xiong Xiao Zhang Siyu Huang Dejing Dou 21 1 0 20 Jun 2021
Spoofing Generalization: When Can't You Trust Proprietary Models? Ankur Moitra Elchanan Mossel Colin Sandon FedML 16 2 0 15 Jun 2021
Compression Implies Generalization Allan Grønlund M. Hogsgaard Lior Kamma Kasper Green Larsen MLT AI4CE 14 0 0 15 Jun 2021
Towards Understanding Generalization via Decomposing Excess Risk Dynamics Jiaye Teng Jianhao Ma Yang Yuan 29 4 0 11 Jun 2021
Early-stopped neural networks are consistent Ziwei Ji Justin D. Li Matus Telgarsky 16 37 0 10 Jun 2021
Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space Sho Sonoda Isao Ishikawa Masahiro Ikeda BDL 19 9 0 09 Jun 2021
LEADS: Learning Dynamical Systems that Generalize Across Environments Yuan Yin Ibrahim Ayed Emmanuel de Bézenac Nicolas Baskiotis Patrick Gallinari OOD 21 31 0 08 Jun 2021
What Makes Multi-modal Learning Better than Single (Provably) Yu Huang Chenzhuang Du Zihui Xue Xuanyao Chen Hang Zhao Longbo Huang 33 251 0 08 Jun 2021
What training reveals about neural network complexity Andreas Loukas Marinos Poiitis Stefanie Jegelka 28 11 0 08 Jun 2021
The Randomness of Input Data Spaces is an A Priori Predictor for Generalization Martin Briesch Dominik Sobania Franz Rothlauf UQCV 35 1 0 08 Jun 2021
Deep Medial Fields Daniel Rebain Ke Li Vincent Sitzmann S. Yazdani K. M. Yi Andrea Tagliasacchi 16 18 0 07 Jun 2021
Adversarial Attack and Defense in Deep Ranking Mo Zhou Le Wang Zhenxing Niu Qilin Zhang N. Zheng G. Hua OOD 34 14 0 07 Jun 2021
Measuring Generalization with Optimal Transport Ching-Yao Chuang Youssef Mroueh Kristjan Greenewald Antonio Torralba Stefanie Jegelka OT 46 25 0 07 Jun 2021
Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path X. Y. Han Vardan Papyan D. Donoho AAML 33 141 0 03 Jun 2021
Exploring Memorization in Adversarial Training Yinpeng Dong Ke Xu Xiao Yang Tianyu Pang Zhijie Deng Hang Su Jun Zhu TDI 33 69 0 03 Jun 2021
Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics Charles H. Martin Michael W. Mahoney 20 19 0 01 Jun 2021