Exploring Generalization in Deep Learning

27 June 2017

Srinadh Bhojanapalli

Papers citing "Exploring Generalization in Deep Learning"

50 / 768 papers shown

Title
Layer-wise Characterization of Latent Information Leakage in Federated Learning Fan Mo Anastasia Borovykh Mohammad Malekzadeh Hamed Haddadi Soteris Demetriou FedML 17 31 0 17 Oct 2020
For self-supervised learning, Rationality implies generalization, provably Yamini Bansal Gal Kaplun Boaz Barak OOD SSL 60 22 0 16 Oct 2020
How does Weight Correlation Affect the Generalisation Ability of Deep Neural Networks Gao Jin Xinping Yi Liang Zhang Lijun Zhang S. Schewe Xiaowei Huang 11 40 0 12 Oct 2020
Medical Image Harmonization Using Deep Learning Based Canonical Mapping: Toward Robust and Generalizable Learning in Imaging V. Bashyam J. Doshi G. Erus D. Srinivasan Ahmed Abdulkadir ... R. Nick David A. Wolk H. Shou I. Nasrallah Christos Davatzikos MedIm 21 17 0 11 Oct 2020
Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior Zi Lin Jeremiah Zhe Liu Ziao Yang Nan Hua Dan Roth 33 46 0 05 Oct 2020
A New Mask R-CNN Based Method for Improved Landslide Detection Silvia Liberata Ullo Amrita Mohan A. Sebastianelli Shaik Ejaz Ahamed B. Kumar R. Dwivedi G. Sinha 21 80 0 04 Oct 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 122 1,283 0 03 Oct 2020
Understanding the Role of Adversarial Regularization in Supervised Learning Litu Rout 18 3 0 01 Oct 2020
Improved generalization by noise enhancement Takashi Mori Masahito Ueda 24 3 0 28 Sep 2020
How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks Keyulu Xu Mozhi Zhang Jingling Li S. Du Ken-ichi Kawarabayashi Stefanie Jegelka MLT 25 306 0 24 Sep 2020
The Relativity of Induction Larry Muhlstein DRL 9 0 0 22 Sep 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 36 79 0 17 Sep 2020
An Extension of Fano's Inequality for Characterizing Model Susceptibility to Membership Inference Attacks Sumit Kumar Jha Susmit Jha Rickard Ewetz Sunny Raj Alvaro Velasquez L. Pullum A. Swami MIACV 14 8 0 17 Sep 2020
Analysis of Generalizability of Deep Neural Networks Based on the Complexity of Decision Boundary Shuyue Guan Murray H. Loew 30 25 0 16 Sep 2020
Deforming the Loss Surface to Affect the Behaviour of the Optimizer Liangming Chen Long Jin Xiujuan Du Shuai Li Mei Liu ODL 14 2 0 14 Sep 2020
How Good is your Explanation? Algorithmic Stability Measures to Assess the Quality of Explanations for Deep Neural Networks Thomas Fel David Vigouroux Rémi Cadène Thomas Serre XAI FAtt 34 31 0 07 Sep 2020
Extreme Memorization via Scale of Initialization Harsh Mehta Ashok Cutkosky Behnam Neyshabur 20 20 0 31 Aug 2020
The Neural Tangent Kernel in High Dimensions: Triple Descent and a Multi-Scale Theory of Generalization Ben Adlam Jeffrey Pennington 23 124 0 15 Aug 2020
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 46 441 0 09 Aug 2020
Generalization Comparison of Deep Neural Networks via Output Sensitivity Mahsa Forouzesh Farnood Salehi Patrick Thiran 12 8 0 30 Jul 2020
Towards Learning Convolutions from Scratch Behnam Neyshabur SSL 220 71 0 27 Jul 2020
Deep Learning Methods for Solving Linear Inverse Problems: Research Directions and Paradigms Yanna Bai Wei Chen Jie Chen Weisi Guo 40 66 0 27 Jul 2020
Tighter risk certificates for neural networks Maria Perez-Ortiz Omar Rivasplata John Shawe-Taylor Csaba Szepesvári UQCV 20 102 0 25 Jul 2020
Deforming the Loss Surface Liangming Chen Long Jin Xiujuan Du Shuai Li Mei Liu ODL 11 0 0 24 Jul 2020
From deep to Shallow: Equivalent Forms of Deep Networks in Reproducing Kernel Krein Space and Indefinite Support Vector Machines A. Shilton Sunil Gupta Santu Rana Svetha Venkatesh 19 0 0 15 Jul 2020
Explicit Regularisation in Gaussian Noise Injections A. Camuto M. Willetts Umut Simsekli Stephen J. Roberts Chris Holmes 25 55 0 14 Jul 2020
Semi-supervised Learning with a Teacher-student Network for Generalized Attribute Prediction Minchul Shin 22 11 0 14 Jul 2020
Robust Learning with Frequency Domain Regularization Weiyu Guo Yidong Ouyang AAML 16 2 0 07 Jul 2020
Are Labels Always Necessary for Classifier Accuracy Evaluation? Weijian Deng Liang Zheng 29 114 0 06 Jul 2020
Self-supervised Neural Architecture Search Sapir Kaplan Raja Giryes SSL 30 12 0 03 Jul 2020
The Restricted Isometry of ReLU Networks: Generalization through Norm Concentration Alex Goessmann Gitta Kutyniok 16 3 0 01 Jul 2020
Using Human Psychophysics to Evaluate Generalization in Scene Text Recognition Models Sahar Siddiqui E. Sizikova Gemma Roig N. Majaj D. Pelli 11 1 0 30 Jun 2020
Data-driven Regularization via Racecar Training for Generalizing Neural Networks You Xie Nils Thuerey 6 0 0 30 Jun 2020
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding Dmitry Lepikhin HyoukJoong Lee Yuanzhong Xu Dehao Chen Orhan Firat Yanping Huang M. Krikun Noam M. Shazeer Zhehuai Chen MoE 43 1,116 0 30 Jun 2020
Composed Fine-Tuning: Freezing Pre-Trained Denoising Autoencoders for Improved Generalization Sang Michael Xie Tengyu Ma Percy Liang 35 13 0 29 Jun 2020
Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum Zeke Xie Xinrui Wang Huishuai Zhang Issei Sato Masashi Sugiyama ODL 32 46 0 29 Jun 2020
The Surprising Simplicity of the Early-Time Learning Dynamics of Neural Networks Wei Hu Lechao Xiao Ben Adlam Jeffrey Pennington 23 62 0 25 Jun 2020
A Limitation of the PAC-Bayes Framework Roi Livni Shay Moran 15 23 0 24 Jun 2020
Understanding Deep Architectures with Reasoning Layer Xinshi Chen Yufei Zhang C. Reisinger Le Song AI4CE 25 6 0 24 Jun 2020
Compositional Learning of Image-Text Query for Image Retrieval Muhammad Umer Anwaar Egor Labintcev M. Kleinsteuber CoGe 24 91 0 19 Jun 2020
What Do Neural Networks Learn When Trained With Random Labels? Hartmut Maennel Ibrahim M. Alabdulmohsin Ilya O. Tolstikhin R. Baldock Olivier Bousquet Sylvain Gelly Daniel Keysers FedML 48 87 0 18 Jun 2020
A Shooting Formulation of Deep Learning François-Xavier Vialard Roland Kwitt Susan Wei Marc Niethammer 13 13 0 18 Jun 2020
Hausdorff Dimension, Heavy Tails, and Generalization in Neural Networks Umut Simsekli Ozan Sener George Deligiannidis Murat A. Erdogdu 44 55 0 16 Jun 2020
Flatness is a False Friend Diego Granziol ODL 18 19 0 16 Jun 2020
PAC-Bayesian Generalization Bounds for MultiLayer Perceptrons Xinjie Lan Xin Guo Kenneth Barner 19 3 0 16 Jun 2020
On the training dynamics of deep networks with $L_2$ regularization Aitor Lewkowycz Guy Gur-Ari 44 53 0 15 Jun 2020
Collegial Ensembles Etai Littwin Ben Myara Sima Sabah J. Susskind Shuangfei Zhai Oren Golan 23 9 0 13 Jun 2020
MetaPerturb: Transferable Regularizer for Heterogeneous Tasks and Architectures Jeongun Ryu Jaewoong Shin Haebeom Lee Sung Ju Hwang AAML OOD 19 8 0 13 Jun 2020
Tangent Space Sensitivity and Distribution of Linear Regions in ReLU Networks Balint Daroczy AAML 6 0 0 11 Jun 2020
On the asymptotics of wide networks with polynomial activations Kyle Aitken Guy Gur-Ari 6 22 0 11 Jun 2020