v1v2 (latest)

Spectrally-normalized margin bounds for neural networks

26 June 2017

Papers citing "Spectrally-normalized margin bounds for neural networks"

50 / 811 papers shown

Title
Mean Field Analysis of Neural Networks: A Central Limit Theorem Justin A. Sirignano K. Spiliopoulos MLT 107 194 0 28 Aug 2018
Spectral Pruning: Compressing Deep Neural Networks via Spectral Analysis and its Generalization Error Taiji Suzuki Hiroshi Abe Tomoya Murata Shingo Horiuchi Kotaro Ito Tokuma Wachi So Hirai Masatoshi Yukishima Tomoaki Nishimura MLT 62 10 0 26 Aug 2018
Learning ReLU Networks on Linearly Separable Data: Algorithm, Optimality, and Generalization G. Wang G. Giannakis Jie Chen MLT 83 132 0 14 Aug 2018
Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data Yuanzhi Li Yingyu Liang MLT 226 653 0 03 Aug 2018
Generalization Error in Deep Learning Daniel Jakubovitz Raja Giryes M. Rodrigues AI4CE 231 111 0 03 Aug 2018
A Surprising Linear Relationship Predicts Test Performance in Deep Networks Q. Liao Brando Miranda Andrzej Banburski Jack Hidary T. Poggio 69 32 0 25 Jul 2018
Learning Deep Hidden Nonlinear Dynamics from Aggregate Data Yisen Wang Bo Dai Lingkai Kong S. Erfani James Bailey H. Zha DiffM 62 10 0 22 Jul 2018
Theory IIIb: Generalization in Deep Networks T. Poggio Q. Liao Brando Miranda Andrzej Banburski Xavier Boix Jack Hidary ODL AI4CE 94 26 0 29 Jun 2018
Overfitting or perfect fitting? Risk bounds for classification and regression rules that interpolate M. Belkin Daniel J. Hsu P. Mitra AI4CE 162 259 0 13 Jun 2018
On Tighter Generalization Bound for Deep Neural Networks: CNNs, ResNets, and Beyond Xingguo Li Junwei Lu Zhaoran Wang Jarvis Haupt T. Zhao 71 80 0 13 Jun 2018
Data augmentation instead of explicit regularization Alex Hernández-García Peter König 111 144 0 11 Jun 2018
Randomized Prior Functions for Deep Reinforcement Learning Ian Osband John Aslanides Albin Cassirer UQCV BDL 87 380 0 08 Jun 2018
Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach Ryo Karakida S. Akaho S. Amari FedML 193 146 0 04 Jun 2018
Minnorm training: an algorithm for training over-parameterized deep neural networks Yamini Bansal Madhu S. Advani David D. Cox Andrew M. Saxe ODL 81 18 0 03 Jun 2018
Interpreting Deep Learning: The Machine Learning Rorschach Test? Adam S. Charles AAML HAI AI4CE 102 9 0 01 Jun 2018
Representational Power of ReLU Networks and Polynomial Kernels: Beyond Worst-Case Analysis Frederic Koehler Andrej Risteski 47 12 0 29 May 2018
Lipschitz regularity of deep neural networks: analysis and efficient estimation Kevin Scaman Aladin Virmaux 121 533 0 28 May 2018
The Singular Values of Convolutional Layers Hanie Sedghi Vineet Gupta Philip M. Long FAtt 93 203 0 26 May 2018
Step Size Matters in Deep Learning Kamil Nar S. Shankar Sastry 47 42 0 22 May 2018
Deep learning generalizes because the parameter-function map is biased towards simple functions Guillermo Valle Pérez Chico Q. Camargo A. Louis MLT AI4CE 122 232 0 22 May 2018
How Many Samples are Needed to Estimate a Convolutional or Recurrent Neural Network? S. Du Yining Wang Xiyu Zhai Sivaraman Balakrishnan Ruslan Salakhutdinov Aarti Singh SSL 91 57 0 21 May 2018
A Study on Overfitting in Deep Reinforcement Learning Chiyuan Zhang Oriol Vinyals Rémi Munos Samy Bengio OffRL OnRL 61 391 0 18 Apr 2018
Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach Wenda Zhou Victor Veitch Morgane Austern Ryan P. Adams Peter Orbanz 87 215 0 16 Apr 2018
Data-Dependent Coresets for Compressing Neural Networks with Applications to Generalization Bounds Cenk Baykal Lucas Liebenwein Igor Gilitschenski Dan Feldman Daniela Rus 80 79 0 15 Apr 2018
Regularisation of Neural Networks by Enforcing Lipschitz Continuity Henry Gouk E. Frank Bernhard Pfahringer M. Cree 179 484 0 12 Apr 2018
Stabilizing Gradients for Deep Neural Networks via Efficient SVD Parameterization Jiong Zhang Qi Lei Inderjit S. Dhillon 55 112 0 25 Mar 2018
Residual Networks: Lyapunov Stability and Convex Decomposition Kamil Nar S. Shankar Sastry ODL 26 3 0 22 Mar 2018
Information Theoretic Interpretation of Deep learning Tianchen Zhao FAtt 64 2 0 21 Mar 2018
FeTa: A DCA Pruning Algorithm with Generalization Error Guarantees Konstantinos Pitas Mike Davies P. Vandergheynst 25 2 0 12 Mar 2018
On the Power of Over-parametrization in Neural Networks with Quadratic Activation S. Du Jason D. Lee 186 272 0 03 Mar 2018
Sensitivity and Generalization in Neural Networks: an Empirical Study Roman Novak Yasaman Bahri Daniel A. Abolafia Jeffrey Pennington Jascha Narain Sohl-Dickstein AAML 99 442 0 23 Feb 2018
Asynchronous Byzantine Machine Learning (the case of SGD) Georgios Damaskinos El-Mahdi El-Mhamdi R. Guerraoui Rhicheek Patra Mahsa Taziki FedML 79 42 0 22 Feb 2018
L2-Nonexpansive Neural Networks Haifeng Qian M. Wegman 75 74 0 22 Feb 2018
Generalization in Machine Learning via Analytical Learning Theory Kenji Kawaguchi Yoshua Bengio Vikas Verma Leslie Pack Kaelbling 55 10 0 21 Feb 2018
Generalization Error Bounds with Probabilistic Guarantee for SGD in Nonconvex Optimization Yi Zhou Yingbin Liang Huishuai Zhang MLT 85 26 0 19 Feb 2018
Guaranteed Recovery of One-Hidden-Layer Neural Networks via Cross Entropy H. Fu Yuejie Chi Yingbin Liang FedML 93 39 0 18 Feb 2018
The Role of Information Complexity and Randomization in Representation Learning Matías Vera Pablo Piantanida L. Rey Vega 80 14 0 14 Feb 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 151 643 0 14 Feb 2018
Towards Understanding the Generalization Bias of Two Layer Convolutional Linear Classifiers with Gradient Descent Yifan Wu Barnabás Póczós Aarti Singh MLT 44 8 0 13 Feb 2018
Lipschitz-Margin Training: Scalable Certification of Perturbation Invariance for Deep Neural Networks Yusuke Tsuzuku Issei Sato Masashi Sugiyama AAML 109 309 0 12 Feb 2018
To understand deep learning we need to understand kernel learning M. Belkin Siyuan Ma Soumik Mandal 119 420 0 05 Feb 2018
Learning Compact Neural Networks with Regularization Samet Oymak MLT 101 39 0 05 Feb 2018
Fix your classifier: the marginal value of training the last weight layer Elad Hoffer Itay Hubara Daniel Soudry 156 102 0 14 Jan 2018
Theory of Deep Learning III: explaining the non-overfitting puzzle T. Poggio Kenji Kawaguchi Q. Liao Brando Miranda Lorenzo Rosasco Xavier Boix Jack Hidary H. Mhaskar ODL 99 128 0 30 Dec 2017
Entropy-SGD optimizes the prior of a PAC-Bayes bound: Generalization properties of Entropy-SGD and data-dependent priors Gintare Karolina Dziugaite Daniel M. Roy MLT 87 145 0 26 Dec 2017
Algorithmic Regularization in Over-parameterized Matrix Sensing and Neural Networks with Quadratic Activations Yuanzhi Li Tengyu Ma Hongyang R. Zhang 74 31 0 26 Dec 2017
The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning Siyuan Ma Raef Bassily M. Belkin 117 291 0 18 Dec 2017
Size-Independent Sample Complexity of Neural Networks Noah Golowich Alexander Rakhlin Ohad Shamir 185 551 0 18 Dec 2017
On the Discrimination-Generalization Tradeoff in GANs Pengchuan Zhang Qiang Liu Dengyong Zhou Tao Xu Xiaodong He 64 104 0 07 Nov 2017
Fisher-Rao Metric, Geometry, and Complexity of Neural Networks Tengyuan Liang T. Poggio Alexander Rakhlin J. Stokes 107 226 0 05 Nov 2017