v1v2 (latest)

Norm-Based Capacity Control in Neural Networks

27 February 2015

Papers citing "Norm-Based Capacity Control in Neural Networks"

50 / 407 papers shown

Title
Weight Expansion: A New Perspective on Dropout and Generalization Gao Jin Xinping Yi Pengfei Yang Lijun Zhang S. Schewe Xiaowei Huang 90 5 0 23 Jan 2022
On generalization bounds for deep networks based on loss surface implicit regularization Masaaki Imaizumi Johannes Schmidt-Hieber ODL 68 3 0 12 Jan 2022
Leveraging Unlabeled Data to Predict Out-of-Distribution Performance Saurabh Garg Sivaraman Balakrishnan Zachary Chase Lipton Behnam Neyshabur Hanie Sedghi OODD OOD 97 131 0 11 Jan 2022
Integral representations of shallow neural network with Rectified Power Unit activation function Ahmed Abdeljawad Philipp Grohs 42 10 0 20 Dec 2021
Learning from Heterogeneous Data Based on Social Interactions over Graphs Virginia Bordignon Stefan Vlaski Vincenzo Matta Ali H. Sayed 66 16 0 17 Dec 2021
Faster Deep Reinforcement Learning with Slower Online Network Kavosh Asadi Rasool Fakoor Omer Gottesman Taesup Kim Michael L. Littman Alexander J. Smola OnRL 68 7 0 10 Dec 2021
Effective dimension of machine learning models Amira Abbas David Sutter Alessio Figalli Stefan Woerner 121 18 0 09 Dec 2021
On the Robustness and Generalization of Deep Learning Driven Full Waveform Inversion Chengyuan Deng Youzuo Lin OOD 56 2 0 28 Nov 2021
How I Learned to Stop Worrying and Love Retraining Max Zimmer Christoph Spiegel Sebastian Pokutta CLL 94 9 0 01 Nov 2021
GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophily Lun Du Xiaozhou Shi Qiang Fu Xiaojun Ma Hengyu Liu Shi Han Dongmei Zhang 139 114 0 29 Oct 2021
Coarse-Grained Smoothness for RL in Metric Spaces Giorgio Giannone Kavosh Asadi Cameron Allen Sam Lobel George Konidaris Michael Littman 80 3 0 23 Oct 2021
Inductive Biases and Variable Creation in Self-Attention Mechanisms Benjamin L. Edelman Surbhi Goel Sham Kakade Cyril Zhang 102 125 0 19 Oct 2021
Path Regularization: A Convexity and Sparsity Inducing Regularization for Parallel ReLU Networks Tolga Ergen Mert Pilanci 94 16 0 18 Oct 2021
Block Contextual MDPs for Continual Learning Shagun Sodhani Franziska Meier Joelle Pineau Amy Zhang CLL 114 27 0 13 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 124 26 0 07 Oct 2021
Ridgeless Interpolation with Shallow ReLU Networks in $1D$ is Nearest Neighbor Curvature Extrapolation and Provably Generalizes on Lipschitz Functions Boris Hanin MLT 78 9 0 27 Sep 2021
When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization? Zheyuan Hu Ameya Dilip Jagtap George Karniadakis Kenji Kawaguchi AI4CE PINN 96 88 0 20 Sep 2021
Uniform Generalization Bounds for Overparameterized Neural Networks Sattar Vakili Michael Bromberg Jezabel R. Garcia Da-shan Shiu A. Bernacchia 125 21 0 13 Sep 2021
The Impact of Reinitialization on Generalization in Convolutional Neural Networks Ibrahim Alabdulmohsin Hartmut Maennel Daniel Keysers AI4CE 61 21 0 01 Sep 2021
A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective? Hiroaki Mikami Kenji Fukumizu Shogo Murai Shuji Suzuki Yuta Kikuchi Taiji Suzuki S. Maeda Kohei Hayashi 92 12 0 25 Aug 2021
Logit Attenuating Weight Normalization Aman Gupta R. Ramanath Jun Shi Anika Ramachandran Sirou Zhou Mingzhou Zhou S. Keerthi 75 1 0 12 Aug 2021
Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers Colin Wei Yining Chen Tengyu Ma 77 92 0 28 Jul 2021
An Embedding of ReLU Networks and an Analysis of their Identifiability Pierre Stock Rémi Gribonval 147 18 0 20 Jul 2021
On Margins and Derandomisation in PAC-Bayes Felix Biggs Benjamin Guedj 93 20 0 08 Jul 2021
RISAN: Robust Instance Specific Abstention Network B. Kalra Kulin Shah Naresh Manwani 22 2 0 07 Jul 2021
Analytic Insights into Structure and Rank of Neural Network Hessian Maps Sidak Pal Singh Gregor Bachmann Thomas Hofmann FAtt 101 37 0 30 Jun 2021
Understanding Adversarial Examples Through Deep Neural Network's Response Surface and Uncertainty Regions Juan Shu B. Xi Charles A. Kamhoua AAML 100 0 0 30 Jun 2021
The Rate of Convergence of Variation-Constrained Deep Neural Networks Gen Li Jie Ding 54 6 0 22 Jun 2021
On Learnability via Gradient Method for Two-Layer ReLU Neural Networks in Teacher-Student Setting Shunta Akiyama Taiji Suzuki MLT 116 13 0 11 Jun 2021
Nonasymptotic theory for two-layer neural networks: Beyond the bias-variance trade-off Huiyuan Wang Wei Lin MLT 41 4 0 09 Jun 2021
Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space Sho Sonoda Isao Ishikawa Masahiro Ikeda BDL 51 9 0 09 Jun 2021
What Makes Multi-modal Learning Better than Single (Provably) Yu Huang Chenzhuang Du Zihui Xue Xuanyao Chen Hang Zhao Longbo Huang 100 268 0 08 Jun 2021
The Randomness of Input Data Spaces is an A Priori Predictor for Generalization Martin Briesch Dominik Sobania Franz Rothlauf UQCV 37 1 0 08 Jun 2021
Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks Melih Barsbey Romain Chor Murat A. Erdogdu Gaël Richard Umut Simsekli 73 41 0 07 Jun 2021
Measuring Generalization with Optimal Transport Ching-Yao Chuang Youssef Mroueh Kristjan Greenewald Antonio Torralba Stefanie Jegelka OT 90 27 0 07 Jun 2021
Optimization Variance: Exploring Generalization Properties of DNNs Xiao Zhang Dongrui Wu Haoyi Xiong Bo Dai 46 4 0 03 Jun 2021
Exploring Memorization in Adversarial Training Yinpeng Dong Ke Xu Xiao Yang Tianyu Pang Zhijie Deng Hang Su Jun Zhu TDI 58 74 0 03 Jun 2021
Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics Charles H. Martin Michael W. Mahoney 75 20 0 01 Jun 2021
Fine-grained Generalization Analysis of Structured Output Prediction Waleed Mustafa Yunwen Lei Antoine Ledent Marius Kloft 80 9 0 31 May 2021
DOC3-Deep One Class Classification using Contradictions Sauptik Dhar Bernardo Gonzalez Torres 125 3 0 17 May 2021
Uniform Convergence, Adversarial Spheres and a Simple Remedy Gregor Bachmann Seyed-Mohsen Moosavi-Dezfooli Thomas Hofmann AAML 38 8 0 07 May 2021
What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theory Rahul Parhi Robert D. Nowak MLT 128 71 0 07 May 2021
RATT: Leveraging Unlabeled Data to Guarantee Generalization Saurabh Garg Sivaraman Balakrishnan J. Zico Kolter Zachary Chase Lipton 82 30 0 01 May 2021
Noether: The More Things Change, the More Stay the Same Grzegorz Gluch R. Urbanke 79 18 0 12 Apr 2021
Analytic function approximation by path norm regularized deep networks A. Beknazaryan 29 2 0 05 Apr 2021
Estimating the Generalization in Deep Neural Networks via Sparsity Yang Zhao Hao Zhang 65 2 0 02 Apr 2021
Deep Learning in current Neuroimaging: a multivariate approach with power and type I error control but arguable generalization ability C. Jiménez-Mesa J. Ramírez J. Suckling Jonathan Voglein J. Levin Juan M Gorriz Alzheimer's Disease Neuroimaging Initiative Adni Dominantly Inherited Alzheimer Network (DIAN) 59 10 0 30 Mar 2021
Risk Bounds for Learning via Hilbert Coresets Spencer Douglas Piyush Kumar R. Prasanth 52 0 0 29 Mar 2021
Conceptual capacity and effective complexity of neural networks Lech Szymanski B. McCane C. Atkinson 28 1 0 13 Mar 2021
Robustness to Pruning Predicts Generalization in Deep Neural Networks Lorenz Kuhn Clare Lyle Aidan Gomez Jonas Rothfuss Y. Gal 91 14 0 10 Mar 2021