v1v2 (latest)

Norm-Based Capacity Control in Neural Networks

27 February 2015

Papers citing "Norm-Based Capacity Control in Neural Networks"

50 / 407 papers shown

Title
Compression based bound for non-compressed network: unified generalization error analysis of large compressible deep neural network Taiji Suzuki Hiroshi Abe Tomoaki Nishimura AI4CE 72 44 0 25 Sep 2019
Deep Neural Networks for Choice Analysis: Architectural Design with Alternative-Specific Utility Functions Shenhao Wang Baichuan Mo Jinhua Zhao 20 1 0 16 Sep 2019
Towards Better Generalization: BP-SVRG in Training Deep Neural Networks Hao Jin Dachao Lin Zhihua Zhang ODL 40 2 0 18 Aug 2019
Fast generalization error bound of deep learning without scale invariance of activation functions Y. Terada Ryoma Hirose MLT 33 7 0 25 Jul 2019
Are deep ResNets provably better than linear predictors? Chulhee Yun S. Sra Ali Jadbabaie 127 12 0 09 Jul 2019
Benign Overfitting in Linear Regression Peter L. Bartlett Philip M. Long Gábor Lugosi Alexander Tsigler MLT 126 780 0 26 Jun 2019
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup Sebastian Goldt Madhu S. Advani Andrew M. Saxe Florent Krzakala Lenka Zdeborová MLT 140 145 0 18 Jun 2019
Stable Rank Normalization for Improved Generalization in Neural Networks and GANs Amartya Sanyal Philip Torr P. Dokania 110 49 0 11 Jun 2019
Network Implosion: Effective Model Compression for ResNets via Static Layer Pruning and Retraining Yasutoshi Ida Yasuhiro Fujiwara 46 1 0 10 Jun 2019
Understanding Generalization through Visualizations Wenjie Huang Z. Emam Micah Goldblum Liam H. Fowl J. K. Terry Furong Huang Tom Goldstein AI4CE 51 80 0 07 Jun 2019
Inductive Bias of Gradient Descent based Adversarial Training on Separable Data Yan Li Ethan X. Fang Huan Xu T. Zhao 92 16 0 07 Jun 2019
Adversarial Training is a Form of Data-dependent Operator Norm Regularization Kevin Roth Yannic Kilcher Thomas Hofmann 58 13 0 04 Jun 2019
What Can Neural Networks Reason About? Keyulu Xu Jingling Li Mozhi Zhang S. Du Ken-ichi Kawarabayashi Stefanie Jegelka NAI AI4CE 106 248 0 30 May 2019
Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks Yuan Cao Quanquan Gu MLT AI4CE 125 392 0 30 May 2019
MaxiMin Active Learning in Overparameterized Model Classes} Mina Karzand Robert D. Nowak 51 20 0 29 May 2019
Generalization bounds for deep convolutional neural networks Philip M. Long Hanie Sedghi MLT 136 90 0 29 May 2019
Norm-based generalisation bounds for multi-class convolutional neural networks Antoine Ledent Waleed Mustafa Yunwen Lei Marius Kloft 66 5 0 29 May 2019
On Dropout and Nuclear Norm Regularization Poorya Mianjy R. Arora 143 23 0 28 May 2019
SGD on Neural Networks Learns Functions of Increasing Complexity Preetum Nakkiran Gal Kaplun Dimitris Kalimeris Tristan Yang Benjamin L. Edelman Fred Zhang Boaz Barak MLT 144 248 0 28 May 2019
Fast Convergence of Natural Gradient Descent for Overparameterized Neural Networks Guodong Zhang James Martens Roger C. Grosse ODL 113 126 0 27 May 2019
What Can ResNet Learn Efficiently, Going Beyond Kernels? Zeyuan Allen-Zhu Yuanzhi Li 416 183 0 24 May 2019
The role of invariance in spectral complexity-based generalization bounds Konstantinos Pitas Andreas Loukas Mike Davies P. Vandergheynst BDL 26 1 0 23 May 2019
Fine-grained Optimization of Deep Neural Networks Mete Ozay ODL 57 2 0 22 May 2019
Data-dependent Sample Complexity of Deep Neural Networks via Lipschitz Augmentation Colin Wei Tengyu Ma 87 110 0 09 May 2019
Sparseout: Controlling Sparsity in Deep Networks Najeeb Khan Ian Stavness BDL 39 9 0 17 Apr 2019
A Selective Overview of Deep Learning Jianqing Fan Cong Ma Yiqiao Zhong BDL VLM 206 135 0 10 Apr 2019
Analysis of the Gradient Descent Algorithm for a Deep Neural Network Model with Skip-connections E. Weinan Chao Ma Qingcan Wang Lei Wu MLT 108 22 0 10 Apr 2019
Limiting Network Size within Finite Bounds for Optimization Linu Pinto Sasi Gopalan 41 2 0 07 Mar 2019
A Priori Estimates of the Population Risk for Residual Networks E. Weinan Chao Ma Qingcan Wang UQCV 103 61 0 06 Mar 2019
How do infinite width bounded norm networks look in function space? Pedro H. P. Savarese Itay Evron Daniel Soudry Nathan Srebro 94 166 0 13 Feb 2019
Uniform convergence may be unable to explain generalization in deep learning Vaishnavh Nagarajan J. Zico Kolter MoMe AI4CE 98 317 0 13 Feb 2019
Generalization Error Bounds of Gradient Descent for Learning Over-parameterized Deep ReLU Networks Yuan Cao Quanquan Gu ODL MLT AI4CE 151 158 0 04 Feb 2019
Complexity, Statistical Risk, and Metric Entropy of Deep Nets Using Total Path Variation Andrew R. Barron Jason M. Klusowski 108 30 0 02 Feb 2019
On Generalization Error Bounds of Noisy Gradient Methods for Non-Convex Learning Jian Li Xuanyuan Luo Mingda Qiao 73 89 0 02 Feb 2019
Effect of Various Regularizers on Model Complexities of Neural Networks in Presence of Input Noise Mayank Sharma Aayush Yadav Sumit Soman Jayadeva Jayadeva 25 1 0 31 Jan 2019
Generalisation dynamics of online learning in over-parameterised neural networks Sebastian Goldt Madhu S. Advani Andrew M. Saxe Florent Krzakala Lenka Zdeborová 46 14 0 25 Jan 2019
Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks Sanjeev Arora S. Du Wei Hu Zhiyuan Li Ruosong Wang MLT 234 974 0 24 Jan 2019
Heavy-Tailed Universality Predicts Trends in Test Accuracies for Very Large Pre-Trained Deep Neural Networks Charles H. Martin Michael W. Mahoney 83 56 0 24 Jan 2019
Generalization in Deep Networks: The Role of Distance from Initialization Vaishnavh Nagarajan J. Zico Kolter ODL 96 96 0 07 Jan 2019
Multitask Learning Deep Neural Networks to Combine Revealed and Stated Preference Data Shenhao Wang Qingyi Wang Jinhuan Zhao AI4TS 73 21 0 02 Jan 2019
A Theoretical Analysis of Deep Q-Learning Jianqing Fan Zhuoran Yang Yuchen Xie Zhaoran Wang 203 611 0 01 Jan 2019
Improving Generalization of Deep Neural Networks by Leveraging Margin Distribution Shen-Huan Lyu Lu Wang Zhi Zhou 41 11 0 27 Dec 2018
Learning finite-dimensional coding schemes with nonlinear reconstruction maps Jaeho Lee Maxim Raginsky 58 9 0 23 Dec 2018
On a Sparse Shortcut Topology of Artificial Neural Networks Fenglei Fan Dayang Wang Hengtao Guo Qikui Zhu Pingkun Yan Ge Wang Hengyong Yu 135 22 0 22 Nov 2018
Stochastic Gradient Descent Optimizes Over-parameterized Deep ReLU Networks Difan Zou Yuan Cao Dongruo Zhou Quanquan Gu ODL 254 448 0 21 Nov 2018
Generalizable Adversarial Training via Spectral Normalization Farzan Farnia Jesse M. Zhang David Tse OOD AAML 83 140 0 19 Nov 2018
Sample Compression, Support Vectors, and Generalization in Deep Learning Christopher Snyder S. Vishwanath MLT 75 5 0 05 Nov 2018
Radius-margin bounds for deep neural networks Mayank Sharma Jayadeva Jayadeva Sumit Soman AAML 33 1 0 03 Nov 2018
Minimax Estimation of Neural Net Distance Kaiyi Ji Yingbin Liang GAN 39 9 0 02 Nov 2018
A Priori Estimates of the Population Risk for Two-layer Neural Networks Weinan E Chao Ma Lei Wu 101 132 0 15 Oct 2018