Spectrally-normalized margin bounds for neural networks

26 June 2017

Papers citing "Spectrally-normalized margin bounds for neural networks"

50 / 804 papers shown

Title
Some Fundamental Aspects about Lipschitz Continuity of Neural Networks Grigory Khromov Sidak Pal Singh 29 7 0 21 Feb 2023
Universality laws for Gaussian mixtures in generalized linear models Yatin Dandi Ludovic Stephan Florent Krzakala Bruno Loureiro Lenka Zdeborová FedML 28 19 0 17 Feb 2023
Online Detection of Changes in Moment-Based Projections: When to Retrain Deep Learners or Update Portfolios? A. Steland 31 0 0 14 Feb 2023
Koopman-based generalization bound: New aspect for full-rank weights Yuka Hashimoto Sho Sonoda Isao Ishikawa Atsushi Nitanda Taiji Suzuki 11 2 0 12 Feb 2023
Generalization in Graph Neural Networks: Improved PAC-Bayesian Bounds on Graph Diffusion Haotian Ju Dongyue Li Aneesh Sharma Hongyang R. Zhang 31 40 0 09 Feb 2023
On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology Francesco Di Giovanni Lorenzo Giusti Federico Barbero Giulia Luise Pietro Lio Michael M. Bronstein 48 112 0 06 Feb 2023
Aligning Robot and Human Representations Andreea Bobu Andi Peng Pulkit Agrawal Julie A. Shah Anca D. Dragan 48 10 0 03 Feb 2023
Sample Complexity of Probability Divergences under Group Symmetry Ziyu Chen Markos A. Katsoulakis Luc Rey-Bellet Weixia Zhu 38 10 0 03 Feb 2023
ResMem: Learn what you can and memorize the rest Zitong Yang Michal Lukasik Vaishnavh Nagarajan Zong-xiao Li A. S. Rawat Manzil Zaheer A. Menon Surinder Kumar VLM 43 8 0 03 Feb 2023
Gradient Descent in Neural Networks as Sequential Learning in RKBS A. Shilton Sunil R. Gupta Santu Rana Svetha Venkatesh MLT 16 1 0 01 Feb 2023
On the Lipschitz Constant of Deep Networks and Double Descent Matteo Gamba Hossein Azizpour Marten Bjorkman 33 7 0 28 Jan 2023
Norm-based Generalization Bounds for Compositionally Sparse Neural Networks Tomer Galanti Mengjia Xu Liane Galanti T. Poggio 35 9 0 28 Jan 2023
Direct Parameterization of Lipschitz-Bounded Deep Networks Ruigang Wang I. Manchester 30 41 0 27 Jan 2023
Out-of-distributional risk bounds for neural operators with applications to the Helmholtz equation Jose Antonio Lara Benitez Takashi Furuya F. Faucher Anastasis Kratsios X. Tricoche Maarten V. de Hoop 42 16 0 27 Jan 2023
Long-tail Detection with Effective Class-Margins Jang Hyun Cho Philipp Krahenbuhl 33 17 0 23 Jan 2023
Stretched and measured neural predictions of complex network dynamics V. Vasiliauskaite Nino Antulov-Fantulin 33 1 0 12 Jan 2023
An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models Yufeng Zhang Boyi Liu Qi Cai Lingxiao Wang Zhaoran Wang 53 11 0 30 Dec 2022
Learning Lipschitz Functions by GD-trained Shallow Overparameterized ReLU Neural Networks Ilja Kuzborskij Csaba Szepesvári 21 4 0 28 Dec 2022
Generalization Bounds for Few-Shot Transfer Learning with Pretrained Classifiers Tomer Galanti András Gyorgy Marcus Hutter VLM SSL 26 3 0 23 Dec 2022
Learning List-Level Domain-Invariant Representations for Ranking Ruicheng Xian Honglei Zhuang Zhen Qin Hamed Zamani Jing Lu Ji Ma Kai Hui Han Zhao Xuanhui Wang Michael Bendersky OOD 54 9 0 21 Dec 2022
Improved Convergence Guarantees for Shallow Neural Networks A. Razborov ODL 27 1 0 05 Dec 2022
Learning-Assisted Algorithm Unrolling for Online Optimization with Budget Constraints Jianyi Yang Shaolei Ren 20 2 0 03 Dec 2022
Adaptive adversarial training method for improving multi-scale GAN based on generalization bound theory Jin-Lin Tang B. Tao Zeyu Gong Zhoupin Yin AI4CE 34 1 0 30 Nov 2022
On the Power of Foundation Models Yang Yuan 20 36 0 29 Nov 2022
Adversarial Rademacher Complexity of Deep Neural Networks Jiancong Xiao Yanbo Fan Ruoyu Sun Zhimin Luo AAML 17 22 0 27 Nov 2022
Why Neural Networks Work Sayan Mukherjee Bernardo A. Huberman 19 2 0 26 Nov 2022
Towards Practical Control of Singular Values of Convolutional Layers Alexandra Senderovich Ekaterina Bulatova Anton Obukhov M. Rakhuba AAML 19 9 0 24 Nov 2022
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States Ziqiao Wang Yongyi Mao 30 10 0 19 Nov 2022
On the Sample Complexity of Two-Layer Networks: Lipschitz vs. Element-Wise Lipschitz Activation Amit Daniely Elad Granot MLT 32 1 0 17 Nov 2022
Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodology Zheyuan Hu Ameya Dilip Jagtap George Karniadakis Kenji Kawaguchi 34 75 0 16 Nov 2022
On the Algorithmic Stability and Generalization of Adaptive Optimization Methods Han Nguyen Hai Pham Sashank J. Reddi Barnabas Poczos ODL AI4CE 17 2 0 08 Nov 2022
Do highly over-parameterized neural networks generalize since bad solutions are rare? Julius Martinetz T. Martinetz 30 1 0 07 Nov 2022
Can neural networks extrapolate? Discussion of a theorem by Pedro Domingos Adrien Courtois Jean-Michel Morel Pablo Arias 21 5 0 07 Nov 2022
Neural PDE Solvers for Irregular Domains Biswajit Khara Ethan Herron Zhanhong Jiang Aditya Balu Chih-Hsuan Yang ... Anushrut Jignasu S. Sarkar C. Hegde A. Krishnamurthy Baskar Ganapathysubramanian AI4CE 24 7 0 07 Nov 2022
Instance-Dependent Generalization Bounds via Optimal Transport Songyan Hou Parnian Kassraie Anastasis Kratsios Andreas Krause Jonas Rothfuss 22 6 0 02 Nov 2022
Neural Active Learning on Heteroskedastic Distributions Savya Khosla Chew Kin Whye Jordan T. Ash Cyril Zhang Kenji Kawaguchi Alex Lamb 30 2 0 02 Nov 2022
Improving Lipschitz-Constrained Neural Networks by Learning Activation Functions Stanislas Ducotterd Alexis Goujon Pakshal Bohra Dimitris Perdios Sebastian Neumayer M. Unser 35 12 0 28 Oct 2022
The Curious Case of Benign Memorization Sotiris Anagnostidis Gregor Bachmann Lorenzo Noci Thomas Hofmann AAML 49 8 0 25 Oct 2022
Understanding the Evolution of Linear Regions in Deep Reinforcement Learning S. Cohan N. Kim David Rolnick M. van de Panne 13 6 0 24 Oct 2022
A PAC-Bayesian Generalization Bound for Equivariant Networks Arash Behboodi Gabriele Cesa Taco S. Cohen 56 17 0 24 Oct 2022
Theoretical analysis of deep neural networks for temporally dependent observations Mingliang Ma Abolfazl Safikhani 17 10 0 20 Oct 2022
Efficiently Computing Local Lipschitz Constants of Neural Networks via Bound Propagation Zhouxing Shi Yihan Wang Huan Zhang Zico Kolter Cho-Jui Hsieh 102 39 0 13 Oct 2022
On the Effectiveness of Lipschitz-Driven Rehearsal in Continual Learning Lorenzo Bonicelli Matteo Boschini Angelo Porrello C. Spampinato Simone Calderara CLL 26 45 0 12 Oct 2022
On the Importance of Gradient Norm in PAC-Bayesian Bounds Itai Gat Yossi Adi A. Schwing Tamir Hazan BDL 37 6 0 12 Oct 2022
Generalization Properties of Retrieval-based Models Soumya Basu A. S. Rawat Manzil Zaheer 36 6 0 06 Oct 2022
Dynamical systems' based neural networks E. Celledoni Davide Murari B. Owren Carola-Bibiane Schönlieb Ferdia Sherry OOD 46 12 0 05 Oct 2022
Self-Distillation for Further Pre-training of Transformers Seanie Lee Minki Kang Juho Lee Sung Ju Hwang Kenji Kawaguchi 47 8 0 30 Sep 2022
Why neural networks find simple solutions: the many regularizers of geometric complexity Benoit Dherin Michael Munn M. Rosca David Barrett 57 31 0 27 Sep 2022
Relational Reasoning via Set Transformers: Provable Efficiency and Applications to MARL Fengzhuo Zhang Boyi Liu Kaixin Wang Vincent Y. F. Tan Zhuoran Yang Zhaoran Wang OffRL LRM 51 10 0 20 Sep 2022
Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks Yunwen Lei Rong Jin Yiming Ying MLT 40 18 0 19 Sep 2022