A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks

29 July 2017

Srinadh Bhojanapalli

Papers citing "A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks"

50 / 152 papers shown

Title
Hierarchical Uncertainty-Aware Graph Neural Network Yoonhyuk Choi Jiho Choi Taewook Ko Chong-Kwon Kim 184 0 0 28 Apr 2025
Generalization Guarantees for Multi-View Representation Learning and Application to Regularization via Gaussian Product Mixture Prior Romain Chor Abdellatif Zaidi Piotr Krasnowski 49 0 0 25 Apr 2025
Representation Retrieval Learning for Heterogeneous Data Integration Qi Xu Annie Qu 55 0 0 12 Mar 2025
Heterogeneity Matters even More in Distributed Learning: Study from Generalization Perspective Masoud Kavian Romain Chor Milad Sefidgaran Abdellatif Zaidi FedML 50 1 0 03 Mar 2025
Generalization Guarantees for Representation Learning via Data-Dependent Gaussian Mixture Priors Romain Chor Milad Sefidgaran Piotr Krasnowski 91 1 0 21 Feb 2025
A Generalization Bound for a Family of Implicit Networks Samy Wu Fung Benjamin Berkels 60 0 0 28 Jan 2025
Understanding Generalization in Quantum Machine Learning with Margins Tak Hur Daniel K. Park AI4CE 34 1 0 11 Nov 2024
Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods Hossein Taheri Christos Thrampoulidis Arya Mazumdar MLT 36 0 0 13 Oct 2024
Efficient Source-Free Time-Series Adaptation via Parameter Subspace Disentanglement Gaurav Patel Christopher Sandino Behrooz Mahasseni Ellen L. Zippi Erdrin Azemi Ali Moin Juri Minxha TTA AI4TS 50 3 0 03 Oct 2024
Deep non-parametric logistic model with case-control data and external summary information Hengchao Shi M. Zheng Wen Yu 30 0 0 03 Sep 2024
What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions? Weijie Tu Weijian Deng Liang Zheng Tom Gedeon 40 0 0 14 Jun 2024
A Margin-based Multiclass Generalization Bound via Geometric Complexity Michael Munn Benoit Dherin Javier Gonzalvo UQCV 40 2 0 28 May 2024
Information-Theoretic Generalization Bounds for Deep Neural Networks Haiyun He Christina Lee Yu 38 4 0 04 Apr 2024
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 62 1 0 08 Nov 2023
PAC-Bayesian Spectrally-Normalized Bounds for Adversarially Robust Generalization Jiancong Xiao Ruoyu Sun Zhimin Luo AAML 38 6 0 09 Oct 2023
Investigating the Ability of PINNs To Solve Burgers' PDE Near Finite-Time BlowUp Dibyakanti Kumar Anirbit Mukherjee 31 2 0 08 Oct 2023
Understanding Deep Neural Networks via Linear Separability of Hidden Layers Chao Zhang Xinyuan Chen Wensheng Li Lixue Liu Wei Wu Dacheng Tao 28 3 0 26 Jul 2023
Sharpness-Aware Graph Collaborative Filtering Huiyuan Chen Chin-Chia Michael Yeh Yujie Fan Yan Zheng Junpeng Wang Vivian Lai Mahashweta Das Hao Yang 31 5 0 18 Jul 2023
Approximation-Generalization Trade-offs under (Approximate) Group Equivariance Mircea Petrache Shubhendu Trivedi 35 22 0 27 May 2023
Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks Puyu Wang Yunwen Lei Di Wang Yiming Ying Ding-Xuan Zhou MLT 29 4 0 26 May 2023
Implicit Bias of Gradient Descent for Logistic Regression at the Edge of Stability Jingfeng Wu Vladimir Braverman Jason D. Lee 32 17 0 19 May 2023
Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape Yan Sun Li Shen Shi-Yong Chen Liang Ding Dacheng Tao FedML 37 33 0 19 May 2023
Understanding the Generalization Ability of Deep Learning Algorithms: A Kernelized Renyi's Entropy Perspective Yuxin Dong Tieliang Gong Hao Chen Chen Li 23 4 0 02 May 2023
Fundamental Tradeoffs in Learning with Prior Information Anirudha Majumdar 32 0 0 26 Apr 2023
Heavy-Tailed Regularization of Weight Matrices in Deep Neural Networks Xuanzhe Xiao Zengyi Li Chuanlong Xie Fengwei Zhou 23 3 0 06 Apr 2023
Koopman-based generalization bound: New aspect for full-rank weights Yuka Hashimoto Sho Sonoda Isao Ishikawa Atsushi Nitanda Taiji Suzuki 11 2 0 12 Feb 2023
Generalization in Graph Neural Networks: Improved PAC-Bayesian Bounds on Graph Diffusion Haotian Ju Dongyue Li Aneesh Sharma Hongyang R. Zhang 31 40 0 09 Feb 2023
Effects of Data Geometry in Early Deep Learning Saket Tiwari George Konidaris 79 7 0 29 Dec 2022
Adaptive adversarial training method for improving multi-scale GAN based on generalization bound theory Jin-Lin Tang B. Tao Zeyu Gong Zhoupin Yin AI4CE 34 1 0 30 Nov 2022
Adversarial Rademacher Complexity of Deep Neural Networks Jiancong Xiao Yanbo Fan Ruoyu Sun Zhimin Luo AAML 17 22 0 27 Nov 2022
PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization Sanae Lotfi Marc Finzi Sanyam Kapoor Andres Potapczynski Micah Goldblum A. Wilson BDL MLT AI4CE 29 51 0 24 Nov 2022
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States Ziqiao Wang Yongyi Mao 30 10 0 19 Nov 2022
Instance-Dependent Generalization Bounds via Optimal Transport Songyan Hou Parnian Kassraie Anastasis Kratsios Andreas Krause Jonas Rothfuss 22 6 0 02 Nov 2022
The Curious Case of Benign Memorization Sotiris Anagnostidis Gregor Bachmann Lorenzo Noci Thomas Hofmann AAML 49 8 0 25 Oct 2022
A PAC-Bayesian Generalization Bound for Equivariant Networks Arash Behboodi Gabriele Cesa Taco S. Cohen 56 17 0 24 Oct 2022
Relational Reasoning via Set Transformers: Provable Efficiency and Applications to MARL Fengzhuo Zhang Boyi Liu Kaixin Wang Vincent Y. F. Tan Zhuoran Yang Zhaoran Wang OffRL LRM 51 10 0 20 Sep 2022
Generalisation under gradient descent via deterministic PAC-Bayes Eugenio Clerico Tyler Farghly George Deligiannidis Benjamin Guedj Arnaud Doucet 31 4 0 06 Sep 2022
On the generalization of learning algorithms that do not converge N. Chandramoorthy Andreas Loukas Khashayar Gatmiry Stefanie Jegelka MLT 19 11 0 16 Aug 2022
On Rademacher Complexity-based Generalization Bounds for Deep Learning Lan V. Truong MLT 47 13 0 08 Aug 2022
An Impartial Take to the CNN vs Transformer Robustness Contest Francesco Pinto Philip Torr P. Dokania UQCV AAML 33 49 0 22 Jul 2022
Contrastive Adapters for Foundation Model Group Robustness Michael Zhang Christopher Ré VLM 18 62 0 14 Jul 2022
When Does Re-initialization Work? Sheheryar Zaidi Tudor Berariu Hyunjik Kim J. Bornschein Claudia Clopath Yee Whye Teh Razvan Pascanu 40 10 0 20 Jun 2022
On the Role of Generalization in Transferability of Adversarial Examples Yilin Wang Farzan Farnia AAML 24 10 0 18 Jun 2022
Benefits of Additive Noise in Composing Classes with Bounded Capacity A. F. Pour H. Ashtiani 33 3 0 14 Jun 2022
Trajectory-dependent Generalization Bounds for Deep Neural Networks via Fractional Brownian Motion Chengli Tan Jiang Zhang Junmin Liu 43 1 0 09 Jun 2022
Generalized Federated Learning via Sharpness Aware Minimization Zhe Qu Xingyu Li Rui Duan Yaojiang Liu Bo Tang Zhuo Lu FedML 31 131 0 06 Jun 2022
Towards Size-Independent Generalization Bounds for Deep Operator Nets Pulkit Gopalani Sayar Karmakar Dibyakanti Kumar Anirbit Mukherjee AI4CE 24 5 0 23 May 2022
Investigating Generalization by Controlling Normalized Margin Alexander R. Farhang Jeremy Bernstein Kushal Tirumala Yang Liu Yisong Yue 31 6 0 08 May 2022
Simultaneous Learning of the Inputs and Parameters in Neural Collaborative Filtering Ramin Raziperchikolaei Young-joo Chung 27 2 0 14 Mar 2022
Enhancing Adversarial Training with Second-Order Statistics of Weights Gao Jin Xinping Yi Wei Huang S. Schewe Xiaowei Huang AAML 29 47 0 11 Mar 2022