Exploring Generalization in Deep Learning

27 June 2017

Srinadh Bhojanapalli

Papers citing "Exploring Generalization in Deep Learning"

50 / 768 papers shown

Title
On the Heavy-Tailed Theory of Stochastic Gradient Descent for Deep Neural Networks Umut Simsekli Mert Gurbuzbalaban T. H. Nguyen G. Richard Levent Sagun 29 55 0 29 Nov 2019
Improving Model Robustness Using Causal Knowledge T. Kyono M. Schaar OOD 27 12 0 27 Nov 2019
Efficient decorrelation of features using Gramian in Reinforcement Learning B. Mavrin D. Graves Alan Chan 20 0 0 19 Nov 2019
Information-Theoretic Local Minima Characterization and Regularization Zhiwei Jia Hao Su 27 19 0 19 Nov 2019
An empirical study of the relation between network architecture and complexity Emir Konuk Kevin Smith 27 7 0 11 Nov 2019
Input-Output Equivalence of Unitary and Contractive RNNs M. Emami Mojtaba Sahraee-Ardakan S. Rangan A. Fletcher 21 1 0 30 Oct 2019
Unifying Variational Inference and PAC-Bayes for Supervised Learning that Scales Sanjay Thakur H. V. Hoof Gunshi Gupta D. Meger BDL 11 2 0 23 Oct 2019
Explicitly Bayesian Regularizations in Deep Learning Xinjie Lan Kenneth Barner UQCV BDL AI4CE 14 1 0 22 Oct 2019
Large Deviation Analysis of Function Sensitivity in Random Deep Neural Networks Bo Li D. Saad 19 12 0 13 Oct 2019
Orchestrating the Development Lifecycle of Machine Learning-Based IoT Applications: A Taxonomy and Survey Bin Qian Jie Su Z. Wen D. N. Jha Yinhao Li ... Albert Y. Zomaya Omer F. Rana Lizhe Wang Maciej Koutny R. Ranjan 28 4 0 11 Oct 2019
Improved Sample Complexities for Deep Networks and Robust Classification via an All-Layer Margin Colin Wei Tengyu Ma AAML OOD 38 85 0 09 Oct 2019
Generalization Bounds for Convolutional Neural Networks Shan Lin Jingwei Zhang MLT 25 34 0 03 Oct 2019
How does topology influence gradient propagation and model performance of deep networks with DenseNet-type skip connections? Kartikeya Bhardwaj Guihong Li R. Marculescu 38 1 0 02 Oct 2019
How noise affects the Hessian spectrum in overparameterized neural networks Ming-Bo Wei D. Schwab 14 27 0 01 Oct 2019
A Constructive Prediction of the Generalization Error Across Scales Jonathan S. Rosenfeld Amir Rosenfeld Yonatan Belinkov Nir Shavit 36 205 0 27 Sep 2019
Wider Networks Learn Better Features D. Gilboa Guy Gur-Ari 15 7 0 25 Sep 2019
A Probabilistic Representation of Deep Learning Xinjie Lan Kenneth Barner UQCV BDL AI4CE 14 1 0 26 Aug 2019
Fast-rate PAC-Bayes Generalization Bounds via Shifted Rademacher Processes Jun Yang Shengyang Sun Daniel M. Roy 9 28 0 20 Aug 2019
PAC-Bayes with Backprop Omar Rivasplata Vikram Tankasali Csaba Szepesvári 21 49 0 19 Aug 2019
Towards Better Generalization: BP-SVRG in Training Deep Neural Networks Hao Jin Dachao Lin Zhihua Zhang ODL 13 2 0 18 Aug 2019
Benchmarking the Robustness of Semantic Segmentation Models Christoph Kamann Carsten Rother VLM UQCV 22 160 0 14 Aug 2019
Investigating Decision Boundaries of Trained Neural Networks Roozbeh Yousefzadeh D. O’Leary AAML 8 21 0 07 Aug 2019
Fast generalization error bound of deep learning without scale invariance of activation functions Y. Terada Ryoma Hirose MLT 19 6 0 25 Jul 2019
Hessian based analysis of SGD for Deep Nets: Dynamics and Generalization Xinyan Li Qilong Gu Yingxue Zhou Tiancong Chen A. Banerjee ODL 42 51 0 24 Jul 2019
Mean Spectral Normalization of Deep Neural Networks for Embedded Automation Anand Subramanian N. Chong 17 2 0 09 Jul 2019
Are deep ResNets provably better than linear predictors? Chulhee Yun S. Sra Ali Jadbabaie 27 12 0 09 Jul 2019
On improving deep learning generalization with adaptive sparse connectivity Shiwei Liu Decebal Constantin Mocanu Mykola Pechenizkiy ODL 20 7 0 27 Jun 2019
On the interplay between noise and curvature and its effect on optimization and generalization Valentin Thomas Fabian Pedregosa B. V. Merrienboer Pierre-Antoine Mangazol Yoshua Bengio Nicolas Le Roux 13 60 0 18 Jun 2019
The Barron Space and the Flow-induced Function Spaces for Neural Network Models E. Weinan Chao Ma Lei Wu 38 109 0 18 Jun 2019
Learning to Forget for Meta-Learning Sungyong Baik Seokil Hong Kyoung Mu Lee CLL KELM 22 87 0 13 Jun 2019
Generalization Guarantees for Neural Networks via Harnessing the Low-rank Structure of the Jacobian Samet Oymak Zalan Fabian Mingchen Li Mahdi Soltanolkotabi MLT 21 88 0 12 Jun 2019
Does Learning Require Memorization? A Short Tale about a Long Tail Vitaly Feldman TDI 58 482 0 12 Jun 2019
Semi-flat minima and saddle points by embedding neural networks to overparameterization Kenji Fukumizu Shoichiro Yamaguchi Yoh-ichi Mototake Mirai Tanaka 3DPC 21 24 0 12 Jun 2019
Stable Rank Normalization for Improved Generalization in Neural Networks and GANs Amartya Sanyal Philip Torr P. Dokania 36 43 0 11 Jun 2019
Stochastic Neural Network with Kronecker Flow Chin-Wei Huang Ahmed Touati Pascal Vincent Gintare Karolina Dziugaite Alexandre Lacoste Aaron Courville BDL 27 8 0 10 Jun 2019
HalalNet: A Deep Neural Network that Classifies the Halalness Slaughtered Chicken from their Images A. Elfakharany Rubiyah Yusof N. Ismail Reza Arfa M. R. Yunus 11 3 0 10 Jun 2019
The Generalization-Stability Tradeoff In Neural Network Pruning Brian Bartoldson Ari S. Morcos Adrian Barbu G. Erlebacher 29 72 0 09 Jun 2019
Understanding Generalization through Visualizations Yifan Jiang Z. Emam Micah Goldblum Liam H. Fowl J. K. Terry Furong Huang Tom Goldstein AI4CE 21 80 0 07 Jun 2019
Deep Semi-Supervised Anomaly Detection Lukas Ruff Robert A. Vandermeulen Nico Görnitz Alexander Binder Emmanuel Müller K. Müller Marius Kloft UQCV 11 540 0 06 Jun 2019
Bad Global Minima Exist and SGD Can Reach Them Shengchao Liu Dimitris Papailiopoulos D. Achlioptas 13 80 0 06 Jun 2019
Towards Task and Architecture-Independent Generalization Gap Predictors Scott Yak J. Gonzalvo Hanna Mazzawi UQCV AI4CE 9 27 0 04 Jun 2019
Adversarial Risk Bounds for Neural Networks through Sparsity based Compression E. Balda Arash Behboodi Niklas Koep R. Mathar AAML 19 7 0 03 Jun 2019
Are Anchor Points Really Indispensable in Label-Noise Learning? Xiaobo Xia Tongliang Liu N. Wang Bo Han Chen Gong Gang Niu Masashi Sugiyama NoLa 22 370 0 01 Jun 2019
Implicit Regularization in Deep Matrix Factorization Sanjeev Arora Nadav Cohen Wei Hu Yuping Luo AI4CE 38 493 0 31 May 2019
Luck Matters: Understanding Training Dynamics of Deep ReLU Networks Yuandong Tian Tina Jiang Qucheng Gong Ari S. Morcos 27 24 0 31 May 2019
Deterministic PAC-Bayesian generalization bounds for deep networks via generalizing noise-resilience Vaishnavh Nagarajan J. Zico Kolter 22 100 0 30 May 2019
Meta Dropout: Learning to Perturb Features for Generalization Haebeom Lee Taewook Nam Eunho Yang Sung Ju Hwang OOD 14 3 0 30 May 2019
Generalization bounds for deep convolutional neural networks Philip M. Long Hanie Sedghi MLT 42 89 0 29 May 2019
Empirically Measuring Concentration: Fundamental Limits on Intrinsic Robustness Saeed Mahloujifar Xiao Zhang Mohammad Mahmoody David Evans 17 22 0 29 May 2019
High Frequency Component Helps Explain the Generalization of Convolutional Neural Networks Haohan Wang Xindi Wu Pengcheng Yin Eric Xing 11 512 0 28 May 2019