Stronger generalization bounds for deep nets via a compression approach

14 February 2018

Papers citing "Stronger generalization bounds for deep nets via a compression approach"

50 / 440 papers shown

Title
Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path X. Y. Han Vardan Papyan D. Donoho AAML 33 141 0 03 Jun 2021
Exploring Memorization in Adversarial Training Yinpeng Dong Ke Xu Xiao Yang Tianyu Pang Zhijie Deng Hang Su Jun Zhu TDI 33 69 0 03 Jun 2021
Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics Charles H. Martin Michael W. Mahoney 20 19 0 01 Jun 2021
LRTuner: A Learning Rate Tuner for Deep Neural Networks Nikhil Iyer V. Thejas Nipun Kwatra Ramachandran Ramjee Muthian Sivathanu ODL 20 1 0 30 May 2021
Compressing Heavy-Tailed Weight Matrices for Non-Vacuous Generalization Bounds John Y. Shin 24 5 0 23 May 2021
A Probabilistic Approach to Neural Network Pruning Xin-Yao Qian Diego Klabjan 37 17 0 20 May 2021
Uniform Convergence, Adversarial Spheres and a Simple Remedy Gregor Bachmann Seyed-Mohsen Moosavi-Dezfooli Thomas Hofmann AAML 17 8 0 07 May 2021
What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theory Rahul Parhi Robert D. Nowak MLT 38 70 0 07 May 2021
A Theoretical-Empirical Approach to Estimating Sample Complexity of DNNs Devansh Bisla Apoorva Nandini Saridena A. Choromańska 30 8 0 05 May 2021
RATT: Leveraging Unlabeled Data to Guarantee Generalization Saurabh Garg Sivaraman Balakrishnan J. Zico Kolter Zachary Chase Lipton 32 30 0 01 May 2021
Non-asymptotic Excess Risk Bounds for Classification with Deep Convolutional Neural Networks Guohao Shen Yuling Jiao Yuanyuan Lin Jian Huang 19 3 0 01 May 2021
Generalization Guarantees for Neural Architecture Search with Train-Validation Split Samet Oymak Mingchen Li Mahdi Soltanolkotabi AI4CE OOD 36 13 0 29 Apr 2021
Generalization bounds via distillation Daniel J. Hsu Ziwei Ji Matus Telgarsky Lan Wang FedML 25 32 0 12 Apr 2021
Noether: The More Things Change, the More Stay the Same Grzegorz Gluch R. Urbanke 22 17 0 12 Apr 2021
Estimating the Generalization in Deep Neural Networks via Sparsity Yang Zhao Hao Zhang 48 2 0 02 Apr 2021
Robustness to Pruning Predicts Generalization in Deep Neural Networks Lorenz Kuhn Clare Lyle Aidan Gomez Jonas Rothfuss Y. Gal 43 14 0 10 Mar 2021
Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models Zitong Yang Yu Bai Song Mei 24 17 0 08 Mar 2021
Evaluation of Complexity Measures for Deep Learning Generalization in Medical Image Analysis Aleksandar Vakanski Min Xian 19 7 0 04 Mar 2021
Lost in Pruning: The Effects of Pruning Neural Networks beyond Test Accuracy Lucas Liebenwein Cenk Baykal Brandon Carter David K Gifford Daniela Rus AAML 40 71 0 04 Mar 2021
Self-Regularity of Non-Negative Output Weights for Overparameterized Two-Layer Neural Networks D. Gamarnik Eren C. Kizildaug Ilias Zadik 32 1 0 02 Mar 2021
LocalDrop: A Hybrid Regularization for Deep Neural Networks Ziqing Lu Chang Xu Bo Du Takashi Ishida Lefei Zhang Masashi Sugiyama 36 15 0 01 Mar 2021
Deep ReLU Networks Preserve Expected Length Boris Hanin Ryan Jeong David Rolnick 29 14 0 21 Feb 2021
Scaling Up Exact Neural Network Compression by ReLU Stability Thiago Serra Xin Yu Abhinav Kumar Srikumar Ramalingam 16 24 0 15 Feb 2021
Generalization Bounds for Meta-Learning via PAC-Bayes and Uniform Stability Alec Farid Anirudha Majumdar 27 34 0 12 Feb 2021
Stability of SGD: Tightness Analysis and Improved Bounds Yikai Zhang Wenjia Zhang Sammy Bald Vamsi Pingali Chao Chen Mayank Goswami MLT 27 36 0 10 Feb 2021
A Deeper Look into Convolutions via Eigenvalue-based Pruning Ilke Çugu Emre Akbas FAtt 13 1 0 04 Feb 2021
Leveraging Local Variation in Data: Sampling and Weighting Schemes for Supervised Deep Learning Paul Novello Gaël Poëtte D. Lugato P. Congedo 19 0 0 19 Jan 2021
Robustness to Augmentations as a Generalization metric Sumukh K Aithal D. Kashyap Natarajan Subramanyam OOD 13 18 0 16 Jan 2021
Heating up decision boundaries: isocapacitory saturation, adversarial scenarios and generalization bounds B. Georgiev L. Franken Mayukh Mukherjee AAML 21 1 0 15 Jan 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning Armen Aghajanyan Luke Zettlemoyer Sonal Gupta 22 536 1 22 Dec 2020
Using noise resilience for ranking generalization of deep neural networks Depen Morwani Rahul Vashisht H. G. Ramaswamy AI4CE 20 1 0 16 Dec 2020
NeurIPS 2020 Competition: Predicting Generalization in Deep Learning Yiding Jiang Pierre Foret Scott Yak Daniel M. Roy H. Mobahi Gintare Karolina Dziugaite Samy Bengio Suriya Gunasekar Isabelle M Guyon Behnam Neyshabur Google Research OOD 24 55 0 14 Dec 2020
A PAC-Bayesian Approach to Generalization Bounds for Graph Neural Networks Renjie Liao R. Urtasun R. Zemel 24 87 0 14 Dec 2020
Semantically Robust Unpaired Image Translation for Data with Unmatched Semantics Statistics Zhiwei Jia Bodi Yuan Kangkang Wang Hong Wu David Clifford Zhiqiang Yuan Hao Su VLM 44 21 0 09 Dec 2020
The Lottery Ticket Hypothesis for Object Recognition Sharath Girish Shishira R. Maiya Kamal Gupta Hao Chen L. Davis Abhinav Shrivastava 83 60 0 08 Dec 2020
Generalization bounds for deep learning Guillermo Valle Pérez A. Louis BDL 13 44 0 07 Dec 2020
Why Unsupervised Deep Networks Generalize Anita de Mello Koch E. Koch R. Koch OOD 18 8 0 07 Dec 2020
Representation Based Complexity Measures for Predicting Generalization in Deep Learning Parth Natekar Manik Sharma 6 36 0 04 Dec 2020
Ranking Neural Checkpoints Yandong Li Xuhui Jia Ruoxin Sang Yukun Zhu Bradley Green Liqiang Wang Boqing Gong FedML ELM UQCV 35 47 0 23 Nov 2020
Neural Abstract Reasoner Victor Kolev B. Georgiev Svetlin Penkov NAI 17 10 0 12 Nov 2020
Geometry Perspective Of Estimating Learning Capability Of Neural Networks Ankan Dutta Arnab Rakshit 8 1 0 03 Nov 2020
A Learning Theoretic Perspective on Local Explainability Jeffrey Li Vaishnavh Nagarajan Gregory Plumb Ameet Talwalkar FAtt 19 16 0 02 Nov 2020
The power of quantum neural networks Amira Abbas David Sutter Christa Zoufal Aurelien Lucchi Alessio Figalli Stefan Woerner 33 726 0 30 Oct 2020
Compressive Sensing and Neural Networks from a Statistical Learning Perspective Arash Behboodi Holger Rauhut Ekkehard Schnoor 8 18 0 29 Oct 2020
An Investigation of how Label Smoothing Affects Generalization Blair Chen Liu Ziyin Zihao Wang Paul Pu Liang UQCV 21 17 0 23 Oct 2020
Deep Learning is Singular, and That's Good Daniel Murfet Susan Wei Biwei Huang Hui Li Jesse Gell-Redman T. Quella UQCV 24 26 0 22 Oct 2020
Learning Curves for Analysis of Deep Networks Derek Hoiem Tanmay Gupta Zhizhong Li Michal Shlapentokh-Rothman 20 25 0 21 Oct 2020
The Deep Bootstrap Framework: Good Online Learners are Good Offline Generalizers Preetum Nakkiran Behnam Neyshabur Hanie Sedghi OffRL 29 11 0 16 Oct 2020
How does Weight Correlation Affect the Generalisation Ability of Deep Neural Networks Gao Jin Xinping Yi Liang Zhang Lijun Zhang S. Schewe Xiaowei Huang 8 40 0 12 Oct 2020
How Does Mixup Help With Robustness and Generalization? Linjun Zhang Zhun Deng Kenji Kawaguchi Amirata Ghorbani James Zou AAML 42 244 0 09 Oct 2020