v1v2 (latest)

Norm-Based Capacity Control in Neural Networks

27 February 2015

Papers citing "Norm-Based Capacity Control in Neural Networks"

50 / 407 papers shown

Title
An ETF view of Dropout regularization Dor Bank Raja Giryes 104 4 0 14 Oct 2018
Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel Colin Wei Jason D. Lee Qiang Liu Tengyu Ma 268 245 0 12 Oct 2018
Understanding Weight Normalized Deep Neural Networks with Rectified Linear Units Yixi Xu Tianlin Li MQ 79 12 0 03 Oct 2018
Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning Charles H. Martin Michael W. Mahoney AI4CE 137 201 0 02 Oct 2018
An analytic theory of generalization dynamics and transfer learning in deep linear networks Andrew Kyle Lampinen Surya Ganguli OOD 92 131 0 27 Sep 2018
Capacity Control of ReLU Neural Networks by Basis-path Norm Shuxin Zheng Qi Meng Huishuai Zhang Wei-neng Chen Nenghai Yu Tie-Yan Liu 67 23 0 19 Sep 2018
Approximation and Estimation for High-Dimensional Deep Learning Networks Andrew R. Barron Jason M. Klusowski 82 59 0 10 Sep 2018
Spectral Pruning: Compressing Deep Neural Networks via Spectral Analysis and its Generalization Error Taiji Suzuki Hiroshi Abe Tomoya Murata Shingo Horiuchi Kotaro Ito Tokuma Wachi So Hirai Masatoshi Yukishima Tomoaki Nishimura MLT 65 10 0 26 Aug 2018
Generalization Error in Deep Learning Daniel Jakubovitz Raja Giryes M. Rodrigues AI4CE 237 111 0 03 Aug 2018
On the Implicit Bias of Dropout Poorya Mianjy R. Arora René Vidal 84 67 0 26 Jun 2018
On Tighter Generalization Bound for Deep Neural Networks: CNNs, ResNets, and Beyond Xingguo Li Junwei Lu Zhaoran Wang Jarvis Haupt T. Zhao 71 80 0 13 Jun 2018
Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach Ryo Karakida S. Akaho S. Amari FedML 199 146 0 04 Jun 2018
Understanding Generalization and Optimization Performance of Deep CNNs Pan Zhou Jiashi Feng MLT 124 50 0 28 May 2018
Learning to Optimize Contextually Constrained Problems for Real-Time Decision-Generation A. Babier Timothy C. Y. Chan Adam Diamant Rafid Mahmood 73 1 0 23 May 2018
Deep learning generalizes because the parameter-function map is biased towards simple functions Guillermo Valle Pérez Chico Q. Camargo A. Louis MLT AI4CE 122 232 0 22 May 2018
Foundations of Sequence-to-Sequence Modeling for Time Series Vitaly Kuznetsov Zelda E. Mariet AI4TS BDL 66 56 0 09 May 2018
N-fold Superposition: Improving Neural Networks by Reducing the Noise in Feature Maps Yang Liu Qiang Qu Chao Gao 29 0 0 23 Apr 2018
Lipschitz Continuity in Model-based Reinforcement Learning Kavosh Asadi Dipendra Kumar Misra Michael L. Littman KELM 109 156 0 19 Apr 2018
Adversarial Training Versus Weight Decay A. Galloway T. Tanay Graham W. Taylor AAML 70 23 0 10 Apr 2018
Gradient Descent Quantizes ReLU Network Features Hartmut Maennel Olivier Bousquet Sylvain Gelly MLT 74 82 0 22 Mar 2018
Constrained Deep Learning using Conditional Gradient and Applications in Computer Vision Sathya Ravi Tuan Dinh Vishnu Suresh Lokhande Vikas Singh AI4CE 71 22 0 17 Mar 2018
On the Power of Over-parametrization in Neural Networks with Quadratic Activation S. Du Jason D. Lee 186 272 0 03 Mar 2018
Functional Gradient Boosting based on Residual Network Perception Atsushi Nitanda Taiji Suzuki 81 27 0 25 Feb 2018
The Role of Information Complexity and Randomization in Representation Learning Matías Vera Pablo Piantanida L. Rey Vega 80 14 0 14 Feb 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 155 643 0 14 Feb 2018
Deep Neural Networks Learn Non-Smooth Functions Effectively Masaaki Imaizumi Kenji Fukumizu 181 124 0 13 Feb 2018
Entropy-SGD optimizes the prior of a PAC-Bayes bound: Generalization properties of Entropy-SGD and data-dependent priors Gintare Karolina Dziugaite Daniel M. Roy MLT 87 145 0 26 Dec 2017
Size-Independent Sample Complexity of Neural Networks Noah Golowich Alexander Rakhlin Ohad Shamir 185 551 0 18 Dec 2017
Mathematics of Deep Learning René Vidal Joan Bruna Raja Giryes Stefano Soatto OOD 70 120 0 13 Dec 2017
Understanding Deep Learning Generalization by Maximum Entropy Guanhua Zheng Jitao Sang Changsheng Xu 41 12 0 21 Nov 2017
Fisher-Rao Metric, Geometry, and Complexity of Neural Networks Tengyuan Liang T. Poggio Alexander Rakhlin J. Stokes 107 226 0 05 Nov 2017
SGD Learns Over-parameterized Networks that Provably Generalize on Linearly Separable Data Alon Brutzkus Amir Globerson Eran Malach Shai Shalev-Shwartz MLT 163 279 0 27 Oct 2017
Function Norms and Regularization in Deep Networks Amal Rannen Triki Maxim Berman Matthew B. Blaschko 78 2 0 18 Oct 2017
Generalization in Deep Learning Kenji Kawaguchi L. Kaelbling Yoshua Bengio ODL 181 460 0 16 Oct 2017
Implicit Regularization in Deep Learning Behnam Neyshabur 94 148 0 06 Sep 2017
The duality structure gradient descent algorithm: analysis and applications to neural networks Thomas Flynn 35 3 0 01 Aug 2017
A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks Behnam Neyshabur Srinadh Bhojanapalli Nathan Srebro 94 610 0 29 Jul 2017
Exploring Generalization in Deep Learning Behnam Neyshabur Srinadh Bhojanapalli David A. McAllester Nathan Srebro FAtt 201 1,261 0 27 Jun 2017
Spectrally-normalized margin bounds for neural networks Peter L. Bartlett Dylan J. Foster Matus Telgarsky ODL 321 1,225 0 26 Jun 2017
Fast learning rate of deep learning via a kernel perspective Taiji Suzuki 51 6 0 29 May 2017
The Landscape of Deep Learning Algorithms Pan Zhou Jiashi Feng 79 24 0 19 May 2017
Geometry of Optimization and Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Ruslan Salakhutdinov Nathan Srebro AI4CE 79 134 0 08 May 2017
Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data Gintare Karolina Dziugaite Daniel M. Roy 126 820 0 31 Mar 2017
Deep Semi-Random Features for Nonlinear Function Approximation Kenji Kawaguchi Bo Xie Vikas Verma Le Song 192 15 0 28 Feb 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 372 4,639 0 10 Nov 2016
Generalization Error of Invariant Classifiers Jure Sokolić Raja Giryes Guillermo Sapiro M. Rodrigues 74 78 0 14 Oct 2016
AdaNet: Adaptive Structural Learning of Artificial Neural Networks Corinna Cortes X. Gonzalvo Vitaly Kuznetsov M. Mohri Scott Yang 99 285 0 05 Jul 2016
Bounds for Vector-Valued Function Estimation Andreas Maurer Massimiliano Pontil 58 7 0 05 Jun 2016
Robust Large Margin Deep Neural Networks Jure Sokolić Raja Giryes Guillermo Sapiro M. Rodrigues 88 309 0 26 May 2016
Path-Normalized Optimization of Recurrent Neural Networks with ReLU Activations Behnam Neyshabur Yuhuai Wu Ruslan Salakhutdinov Nathan Srebro AI4CE ODL 78 30 0 23 May 2016