Exploring Generalization in Deep Learning

27 June 2017

Srinadh Bhojanapalli

Papers citing "Exploring Generalization in Deep Learning"

50 / 766 papers shown

Title
Practical Assessment of Generalization Performance Robustness for Deep Networks via Contrastive Examples Xuanyu Wu Xuhong Li Haoyi Xiong Xiao Zhang Siyu Huang Dejing Dou 13 1 0 20 Jun 2021
A Probabilistic Representation of DNNs: Bridging Mutual Information and Generalization Xinjie Lan Kenneth Barner 29 1 0 18 Jun 2021
Deep Learning Through the Lens of Example Difficulty R. Baldock Hartmut Maennel Behnam Neyshabur 47 156 0 17 Jun 2021
Analysis and Optimisation of Bellman Residual Errors with Neural Function Approximation Martin Gottwald Sven Gronauer Hao Shen Klaus Diepold 6 3 0 16 Jun 2021
On the Sample Complexity and Metastability of Heavy-tailed Policy Search in Continuous Control Amrit Singh Bedi Anjaly Parayil Junyu Zhang Mengdi Wang Alec Koppel 33 15 0 15 Jun 2021
Towards Understanding Generalization via Decomposing Excess Risk Dynamics Jiaye Teng Jianhao Ma Yang Yuan 29 4 0 11 Jun 2021
Learning distinct features helps, provably Firas Laakom Jenni Raitoharju Alexandros Iosifidis Moncef Gabbouj MLT 36 6 0 10 Jun 2021
What Does Rotation Prediction Tell Us about Classifier Accuracy under Varying Testing Environments? Weijian Deng Stephen Gould Liang Zheng 39 62 0 10 Jun 2021
A multi-stage GAN for multi-organ chest X-ray image generation and segmentation Giorgio Ciano P. Andreini Tommaso Mazzierli Monica Bianchini F. Scarselli GAN MedIm 29 19 0 09 Jun 2021
The dilemma of quantum neural networks Yan Qian Xinbiao Wang Yuxuan Du Xingyao Wu Dacheng Tao 21 30 0 09 Jun 2021
Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms A. Camuto George Deligiannidis Murat A. Erdogdu Mert Gurbuzbalaban Umut cSimcsekli Lingjiong Zhu 33 29 0 09 Jun 2021
One Semantic Parser to Parse Them All: Sequence to Sequence Multi-Task Learning on Semantic Parsing Datasets Marco Damonte Emilio Monti AIMat 33 6 0 08 Jun 2021
The Randomness of Input Data Spaces is an A Priori Predictor for Generalization Martin Briesch Dominik Sobania Franz Rothlauf UQCV 35 1 0 08 Jun 2021
Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path X. Y. Han Vardan Papyan D. Donoho AAML 33 136 0 03 Jun 2021
Optimization Variance: Exploring Generalization Properties of DNNs Xiao Zhang Dongrui Wu Haoyi Xiong Bo Dai 20 4 0 03 Jun 2021
Exploring Memorization in Adversarial Training Yinpeng Dong Ke Xu Xiao Yang Tianyu Pang Zhijie Deng Hang Su Jun Zhu TDI 33 69 0 03 Jun 2021
Characterization of Generalizability of Spike Timing Dependent Plasticity trained Spiking Neural Networks Biswadeep Chakraborty Saibal Mukhopadhyay 12 15 0 31 May 2021
On Linear Stability of SGD and Input-Smoothness of Neural Networks Chao Ma Lexing Ying MLT 25 44 0 27 May 2021
Probing the Effect of Selection Bias on Generalization: A Thought Experiment John K. Tsotsos Jun Luo CML 24 2 0 20 May 2021
What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theory Rahul Parhi Robert D. Nowak MLT 38 70 0 07 May 2021
Implicit Regularization in Deep Tensor Factorization P. Milanesi Hachem Kadri Stéphane Ayache Thierry Artières 54 9 0 04 May 2021
Synthetic Data for Model Selection Alon Shoshan Nadav Bhonker Igor Kviatkovsky Matan Fintz Gérard Medioni 21 5 0 03 May 2021
RATT: Leveraging Unlabeled Data to Guarantee Generalization Saurabh Garg Sivaraman Balakrishnan J. Zico Kolter Zachary Chase Lipton 30 30 0 01 May 2021
Generalization Guarantees for Neural Architecture Search with Train-Validation Split Samet Oymak Mingchen Li Mahdi Soltanolkotabi AI4CE OOD 36 13 0 29 Apr 2021
PAC Bayesian Performance Guarantees for Deep (Stochastic) Networks in Medical Imaging Anthony Sicilia Xingchen Zhao Anastasia Sosnovskikh Seong Jae Hwang BDL UQCV 19 4 0 12 Apr 2021
Noether: The More Things Change, the More Stay the Same Grzegorz Gluch R. Urbanke 22 17 0 12 Apr 2021
Relating Adversarially Robust Generalization to Flat Minima David Stutz Matthias Hein Bernt Schiele OOD 32 65 0 09 Apr 2021
The Fragility of Noise Estimation in Kalman Filter: Optimization Can Handle Model-Misspecification Ido Greenberg Shie Mannor Netanel Yannay 21 3 0 06 Apr 2021
Defending Against Image Corruptions Through Adversarial Augmentations D. A. Calian Florian Stimberg Olivia Wiles Sylvestre-Alvise Rebuffi András Gyorgy Timothy A. Mann Sven Gowal AAML 17 41 0 02 Apr 2021
Estimating the Generalization in Deep Neural Networks via Sparsity Yang Zhao Hao Zhang 48 2 0 02 Apr 2021
Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization Zeke Xie Li-xin Yuan Zhanxing Zhu Masashi Sugiyama 27 29 0 31 Mar 2021
Deep Learning in current Neuroimaging: a multivariate approach with power and type I error control but arguable generalization ability C. Jiménez-Mesa J. Ramírez J. Suckling Jonathan Voglein J. Levin Juan M Gorriz Alzheimer's Disease Neuroimaging Initiative Adni Dominantly Inherited Alzheimer Network (DIAN) 19 10 0 30 Mar 2021
Nonlinear Weighted Directed Acyclic Graph and A Priori Estimates for Neural Networks Yuqing Li Tao Luo Chao Ma CML 11 1 0 30 Mar 2021
Lower Bounds on the Generalization Error of Nonlinear Learning Models Inbar Seroussi Ofer Zeitouni 21 5 0 26 Mar 2021
Recent Advances in Large Margin Learning Yiwen Guo Changshui Zhang AAML AI4CE 30 13 0 25 Mar 2021
Adaptive Degradation Process with Deep Learning-Driven Trajectory Li Yang 16 0 0 22 Mar 2021
Multi-Prize Lottery Ticket Hypothesis: Finding Accurate Binary Neural Networks by Pruning A Randomly Weighted Network James Diffenderfer B. Kailkhura MQ 35 75 0 17 Mar 2021
Conceptual capacity and effective complexity of neural networks Lech Szymanski B. McCane C. Atkinson 11 1 0 13 Mar 2021
Why flatness does and does not correlate with generalization for deep neural networks Shuo Zhang Isaac Reid Guillermo Valle Pérez A. Louis 11 8 0 10 Mar 2021
Robustness to Pruning Predicts Generalization in Deep Neural Networks Lorenz Kuhn Clare Lyle Aidan Gomez Jonas Rothfuss Y. Gal 43 14 0 10 Mar 2021
Evaluation of Complexity Measures for Deep Learning Generalization in Medical Image Analysis Aleksandar Vakanski Min Xian 11 7 0 04 Mar 2021
Formalizing Generalization and Robustness of Neural Networks to Weight Perturbations Yu-Lin Tsai Chia-Yi Hsu Chia-Mu Yu Pin-Yu Chen AAML OOD 33 26 0 03 Mar 2021
Self-Regularity of Non-Negative Output Weights for Overparameterized Two-Layer Neural Networks D. Gamarnik Eren C. Kizildaug Ilias Zadik 27 1 0 02 Mar 2021
Smoothness Analysis of Adversarial Training Sekitoshi Kanai Masanori Yamada Hiroshi Takahashi Yuki Yamanaka Yasutoshi Ida AAML 40 6 0 02 Mar 2021
ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks Jungmin Kwon Jeongseop Kim Hyunseong Park I. Choi 48 281 0 23 Feb 2021
Low Curvature Activations Reduce Overfitting in Adversarial Training Vasu Singla Sahil Singla David Jacobs S. Feizi AAML 32 45 0 15 Feb 2021
Weak Adaptation Learning -- Addressing Cross-domain Data Insufficiency with Weak Annotator Shichao Xu Lixu Wang Yixuan Wang Qi Zhu 27 15 0 15 Feb 2021
Generalization Bounds for Meta-Learning via PAC-Bayes and Uniform Stability Alec Farid Anirudha Majumdar 27 34 0 12 Feb 2021
Towards Certifying L-infinity Robustness using Neural Networks with L-inf-dist Neurons Bohang Zhang Tianle Cai Zhou Lu Di He Liwei Wang OOD 37 49 0 10 Feb 2021
Understanding Instance-Level Label Noise: Disparate Impacts and Treatments Yang Liu NoLa 8 35 0 10 Feb 2021