v1v2 (latest)

Spectrally-normalized margin bounds for neural networks

26 June 2017

Papers citing "Spectrally-normalized margin bounds for neural networks"

50 / 811 papers shown

Title
Observational Overfitting in Reinforcement Learning Xingyou Song Yiding Jiang Stephen Tu Yilun Du Behnam Neyshabur OffRL 129 140 0 06 Dec 2019
Fantastic Generalization Measures and Where to Find Them Yiding Jiang Behnam Neyshabur H. Mobahi Dilip Krishnan Samy Bengio AI4CE 150 612 0 04 Dec 2019
The intriguing role of module criticality in the generalization of deep networks Niladri S. Chatterji Behnam Neyshabur Hanie Sedghi 89 53 0 02 Dec 2019
How Much Over-parameterization Is Sufficient to Learn Deep ReLU Networks? Zixiang Chen Yuan Cao Difan Zou Quanquan Gu 77 123 0 27 Nov 2019
Fantastic Four: Differentiable Bounds on Singular Values of Convolution Layers Sahil Singla Soheil Feizi AAML 61 8 0 22 Nov 2019
Information-Theoretic Local Minima Characterization and Regularization Zhiwei Jia Hao Su 75 19 0 19 Nov 2019
Risk bounds for reservoir computing Lukas Gonon Lyudmila Grigoryeva Juan-Pablo Ortega 102 40 0 30 Oct 2019
On Generalization Bounds of a Family of Recurrent Neural Networks Minshuo Chen Xingguo Li T. Zhao 81 71 0 28 Oct 2019
Diametrical Risk Minimization: Theory and Computations Matthew Norton J. Royset 59 19 0 24 Oct 2019
Global Capacity Measures for Deep ReLU Networks via Path Sampling Ryan Theisen Jason M. Klusowski Huan Wang N. Keskar Caiming Xiong R. Socher 36 3 0 22 Oct 2019
On Warm-Starting Neural Network Training Jordan T. Ash Ryan P. Adams AI4CE 58 21 0 18 Oct 2019
Improved Generalization Bounds of Group Invariant / Equivariant Deep Networks via Quotient Feature Spaces Akiyoshi Sannai Masaaki Imaizumi M. Kawano MLT 55 31 0 15 Oct 2019
Notes on Margin Training and Margin p-Values for Deep Neural Network Classifiers G. Kesidis David J. Miller Zhen Xiang 23 0 0 15 Oct 2019
Large Deviation Analysis of Function Sensitivity in Random Deep Neural Networks Bo Li D. Saad 64 12 0 13 Oct 2019
Generalization Bounds for Neural Networks via Approximate Description Length Amit Daniely Elad Granot 86 21 0 13 Oct 2019
Improved Sample Complexities for Deep Networks and Robust Classification via an All-Layer Margin Colin Wei Tengyu Ma AAML OOD 74 85 0 09 Oct 2019
Algorithm-Dependent Generalization Bounds for Overparameterized Deep Residual Networks Spencer Frei Yuan Cao Quanquan Gu ODL 82 31 0 07 Oct 2019
Beyond Linearization: On Quadratic and Higher-Order Approximation of Wide Neural Networks Yu Bai Jason D. Lee 67 116 0 03 Oct 2019
Generalization Bounds for Convolutional Neural Networks Shan Lin Jingwei Zhang MLT 60 35 0 03 Oct 2019
How does topology influence gradient propagation and model performance of deep networks with DenseNet-type skip connections? Kartikeya Bhardwaj Guihong Li R. Marculescu 58 1 0 02 Oct 2019
Compression based bound for non-compressed network: unified generalization error analysis of large compressible deep neural network Taiji Suzuki Hiroshi Abe Tomoaki Nishimura AI4CE 72 44 0 25 Sep 2019
Imitation Learning from Pixel-Level Demonstrations by HashReward Xin-Qiang Cai Yao-Xiang Ding Yuan Jiang Zhi Zhou 41 10 0 09 Sep 2019
Dissecting Non-Vacuous Generalization Bounds based on the Mean-Field Approximation Konstantinos Pitas 70 8 0 06 Sep 2019
Convergence Rates of Variational Inference in Sparse Deep Learning Badr-Eddine Chérief-Abdellatif BDL 122 39 0 09 Aug 2019
Behaviour Suite for Reinforcement Learning Ian Osband Yotam Doron Matteo Hessel John Aslanides Eren Sezener ... Satinder Singh Benjamin Van Roy R. Sutton David Silver H. V. Hasselt OffRL 115 183 0 09 Aug 2019
Mini-batch Metropolis-Hastings MCMC with Reversible SGLD Proposal Tung-Yu Wu Y. X. R. Wang W. Wong 93 11 0 08 Aug 2019
Fast generalization error bound of deep learning without scale invariance of activation functions Y. Terada Ryoma Hirose MLT 33 7 0 25 Jul 2019
Hessian based analysis of SGD for Deep Nets: Dynamics and Generalization Xinyan Li Qilong Gu Yingxue Zhou Tiancong Chen A. Banerjee ODL 88 52 0 24 Jul 2019
Ordered SGD: A New Stochastic Optimization Framework for Empirical Risk Minimization Kenji Kawaguchi Haihao Lu ODL 100 64 0 09 Jul 2019
Characterizing Inter-Layer Functional Mappings of Deep Learning Models D. Waagen Katie Rainey Jamie Gantert David Gray Megan King M. S. Thompson Jonathan Barton Will Waldron S. Livingston D. Hulsey 18 5 0 09 Jul 2019
Mean Spectral Normalization of Deep Neural Networks for Embedded Automation Anand Subramanian N. Chong 19 2 0 09 Jul 2019
Are deep ResNets provably better than linear predictors? Chulhee Yun S. Sra Ali Jadbabaie 127 12 0 09 Jul 2019
Circuit-Based Intrinsic Methods to Detect Overfitting S. Chatterjee A. Mishchenko 55 6 0 03 Jul 2019
On Symmetry and Initialization for Neural Networks Ido Nachum Amir Yehudayoff MLT 59 5 0 01 Jul 2019
Benign Overfitting in Linear Regression Peter L. Bartlett Philip M. Long Gábor Lugosi Alexander Tsigler MLT 126 780 0 26 Jun 2019
Chaining Meets Chain Rule: Multilevel Entropic Regularization and Training of Neural Nets Amir-Reza Asadi Emmanuel Abbe BDL AI4CE 85 13 0 26 Jun 2019
Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss Kaidi Cao Colin Wei Adrien Gaidon Nikos Arechiga Tengyu Ma 137 1,614 0 18 Jun 2019
Interpolated Adversarial Training: Achieving Robust Neural Networks without Sacrificing Too Much Accuracy Alex Lamb Vikas Verma Kenji Kawaguchi Alexander Matyasko Savya Khosla Arno Solin Yoshua Bengio AAML 70 99 0 16 Jun 2019
Divide and Conquer: Leveraging Intermediate Feature Representations for Quantized Training of Neural Networks Ahmed T. Elthakeb Prannoy Pilligundla Alex Cloninger H. Esmaeilzadeh MQ 53 8 0 14 Jun 2019
Gradient Descent Maximizes the Margin of Homogeneous Neural Networks Kaifeng Lyu Jian Li 114 336 0 13 Jun 2019
Robust Regression for Safe Exploration in Control Anqi Liu Guanya Shi Soon-Jo Chung Anima Anandkumar Yisong Yue 92 60 0 13 Jun 2019
Does Learning Require Memorization? A Short Tale about a Long Tail Vitaly Feldman TDI 189 504 0 12 Jun 2019
Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networks Mahyar Fazlyab Alexander Robey Hamed Hassani M. Morari George J. Pappas 142 462 0 12 Jun 2019
Stable Rank Normalization for Improved Generalization in Neural Networks and GANs Amartya Sanyal Philip Torr P. Dokania 110 49 0 11 Jun 2019
Characterizing the implicit bias via a primal-dual analysis Ziwei Ji Matus Telgarsky 75 20 0 11 Jun 2019
Stochastic Neural Network with Kronecker Flow Chin-Wei Huang Ahmed Touati Pascal Vincent Gintare Karolina Dziugaite Alexandre Lacoste Aaron Courville BDL 67 8 0 10 Jun 2019
Understanding Generalization through Visualizations Wenjie Huang Z. Emam Micah Goldblum Liam H. Fowl J. K. Terry Furong Huang Tom Goldstein AI4CE 51 80 0 07 Jun 2019
Iterative Self-Learning: Semi-Supervised Improvement to Dataset Volumes and Model Accuracy R. Dupre Jiri Fajtl Vasileios Argyriou Paolo Remagnino 34 2 0 06 Jun 2019
Towards Task and Architecture-Independent Generalization Gap Predictors Scott Yak J. Gonzalvo Hanna Mazzawi UQCV AI4CE 59 27 0 04 Jun 2019
Adversarial Training is a Form of Data-dependent Operator Norm Regularization Kevin Roth Yannic Kilcher Thomas Hofmann 58 13 0 04 Jun 2019