v1v2v3v4 (latest)

Stronger generalization bounds for deep nets via a compression approach

14 February 2018

Papers citing "Stronger generalization bounds for deep nets via a compression approach"

50 / 444 papers shown

Title
Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms A. Camuto George Deligiannidis Murat A. Erdogdu Mert Gurbuzbalaban Umut cSimcsekli Lingjiong Zhu 83 29 0 09 Jun 2021
Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space Sho Sonoda Isao Ishikawa Masahiro Ikeda BDL 62 9 0 09 Jun 2021
What training reveals about neural network complexity Andreas Loukas Marinos Poiitis Stefanie Jegelka 77 11 0 08 Jun 2021
The Randomness of Input Data Spaces is an A Priori Predictor for Generalization Martin Briesch Dominik Sobania Franz Rothlauf UQCV 49 1 0 08 Jun 2021
Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks Melih Barsbey Romain Chor Murat A. Erdogdu Gaël Richard Umut Simsekli 73 41 0 07 Jun 2021
Measuring Generalization with Optimal Transport Ching-Yao Chuang Youssef Mroueh Kristjan Greenewald Antonio Torralba Stefanie Jegelka OT 92 27 0 07 Jun 2021
Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path X. Y. Han Vardan Papyan D. Donoho AAML 155 144 0 03 Jun 2021
Exploring Memorization in Adversarial Training Yinpeng Dong Ke Xu Xiao Yang Tianyu Pang Zhijie Deng Hang Su Jun Zhu TDI 67 74 0 03 Jun 2021
Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics Charles H. Martin Michael W. Mahoney 75 20 0 01 Jun 2021
LRTuner: A Learning Rate Tuner for Deep Neural Networks Nikhil Iyer V. Thejas Nipun Kwatra Ramachandran Ramjee Muthian Sivathanu ODL 60 1 0 30 May 2021
Compressing Heavy-Tailed Weight Matrices for Non-Vacuous Generalization Bounds John Y. Shin 148 5 0 23 May 2021
A Probabilistic Approach to Neural Network Pruning Xin-Yao Qian Diego Klabjan 96 17 0 20 May 2021
Uniform Convergence, Adversarial Spheres and a Simple Remedy Gregor Bachmann Seyed-Mohsen Moosavi-Dezfooli Thomas Hofmann AAML 47 8 0 07 May 2021
What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theory Rahul Parhi Robert D. Nowak MLT 140 71 0 07 May 2021
A Theoretical-Empirical Approach to Estimating Sample Complexity of DNNs Devansh Bisla Apoorva Nandini Saridena A. Choromańska 69 8 0 05 May 2021
RATT: Leveraging Unlabeled Data to Guarantee Generalization Saurabh Garg Sivaraman Balakrishnan J. Zico Kolter Zachary Chase Lipton 94 30 0 01 May 2021
Non-asymptotic Excess Risk Bounds for Classification with Deep Convolutional Neural Networks Guohao Shen Yuling Jiao Yuanyuan Lin Jian Huang 79 3 0 01 May 2021
Generalization Guarantees for Neural Architecture Search with Train-Validation Split Samet Oymak Mingchen Li Mahdi Soltanolkotabi AI4CE OOD 88 15 0 29 Apr 2021
Generalization bounds via distillation Daniel J. Hsu Ziwei Ji Matus Telgarsky Lan Wang FedML 65 34 0 12 Apr 2021
Noether: The More Things Change, the More Stay the Same Grzegorz Gluch R. Urbanke 79 18 0 12 Apr 2021
Estimating the Generalization in Deep Neural Networks via Sparsity Yang Zhao Hao Zhang 92 2 0 02 Apr 2021
Robustness to Pruning Predicts Generalization in Deep Neural Networks Lorenz Kuhn Clare Lyle Aidan Gomez Jonas Rothfuss Y. Gal 105 14 0 10 Mar 2021
Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models Zitong Yang Yu Bai Song Mei 76 18 0 08 Mar 2021
Evaluation of Complexity Measures for Deep Learning Generalization in Medical Image Analysis Aleksandar Vakanski Min Xian 56 7 0 04 Mar 2021
Lost in Pruning: The Effects of Pruning Neural Networks beyond Test Accuracy Lucas Liebenwein Cenk Baykal Brandon Carter David K Gifford Daniela Rus AAML 84 74 0 04 Mar 2021
Self-Regularity of Non-Negative Output Weights for Overparameterized Two-Layer Neural Networks D. Gamarnik Eren C. Kizildaug Ilias Zadik 97 1 0 02 Mar 2021
LocalDrop: A Hybrid Regularization for Deep Neural Networks Ziqing Lu Chang Xu Bo Du Takashi Ishida Lefei Zhang Masashi Sugiyama 84 15 0 01 Mar 2021
Deep ReLU Networks Preserve Expected Length Boris Hanin Ryan Jeong David Rolnick 75 14 0 21 Feb 2021
Scaling Up Exact Neural Network Compression by ReLU Stability Thiago Serra Xin Yu Abhinav Kumar Srikumar Ramalingam 70 24 0 15 Feb 2021
Generalization Bounds for Meta-Learning via PAC-Bayes and Uniform Stability Alec Farid Anirudha Majumdar 81 36 0 12 Feb 2021
Stability of SGD: Tightness Analysis and Improved Bounds Yikai Zhang Wenjia Zhang Sammy Bald Vamsi Pingali Chao Chen Mayank Goswami MLT 59 38 0 10 Feb 2021
A Deeper Look into Convolutions via Eigenvalue-based Pruning Ilke Çugu Emre Akbas FAtt 63 1 0 04 Feb 2021
Leveraging Local Variation in Data: Sampling and Weighting Schemes for Supervised Deep Learning Paul Novello Gaël Poëtte D. Lugato P. Congedo 132 0 0 19 Jan 2021
Robustness to Augmentations as a Generalization metric Sumukh K Aithal D. Kashyap Natarajan Subramanyam OOD 41 18 0 16 Jan 2021
Heating up decision boundaries: isocapacitory saturation, adversarial scenarios and generalization bounds B. Georgiev L. Franken Mayukh Mukherjee AAML 48 1 0 15 Jan 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning Armen Aghajanyan Luke Zettlemoyer Sonal Gupta 124 579 1 22 Dec 2020
Using noise resilience for ranking generalization of deep neural networks Depen Morwani Rahul Vashisht H. G. Ramaswamy AI4CE 57 1 0 16 Dec 2020
NeurIPS 2020 Competition: Predicting Generalization in Deep Learning Yiding Jiang Pierre Foret Scott Yak Daniel M. Roy H. Mobahi Gintare Karolina Dziugaite Samy Bengio Suriya Gunasekar Isabelle M Guyon Behnam Neyshabur Google Research OOD 89 55 0 14 Dec 2020
A PAC-Bayesian Approach to Generalization Bounds for Graph Neural Networks Renjie Liao R. Urtasun R. Zemel 100 90 0 14 Dec 2020
Semantically Robust Unpaired Image Translation for Data with Unmatched Semantics Statistics Zhiwei Jia Bodi Yuan Kangkang Wang Hong Wu David Clifford Zhiqiang Yuan Hao Su VLM 110 23 0 09 Dec 2020
The Lottery Ticket Hypothesis for Object Recognition Sharath Girish Shishira R. Maiya Kamal Gupta Hao Chen L. Davis Abhinav Shrivastava 144 61 0 08 Dec 2020
Generalization bounds for deep learning Guillermo Valle Pérez A. Louis BDL 84 45 0 07 Dec 2020
Why Unsupervised Deep Networks Generalize Anita de Mello Koch E. Koch R. Koch OOD 49 8 0 07 Dec 2020
Representation Based Complexity Measures for Predicting Generalization in Deep Learning Parth Natekar Manik Sharma 66 36 0 04 Dec 2020
Ranking Neural Checkpoints Yandong Li Xuhui Jia Ruoxin Sang Yukun Zhu Bradley Green Liqiang Wang Boqing Gong FedML ELM UQCV 122 49 0 23 Nov 2020
Neural Abstract Reasoner Victor Kolev B. Georgiev Svetlin Penkov NAI 73 10 0 12 Nov 2020
Geometry Perspective Of Estimating Learning Capability Of Neural Networks Ankan Dutta Arnab Rakshit 55 1 0 03 Nov 2020
A Learning Theoretic Perspective on Local Explainability Jeffrey Li Vaishnavh Nagarajan Gregory Plumb Ameet Talwalkar FAtt 62 18 0 02 Nov 2020
The power of quantum neural networks Amira Abbas David Sutter Christa Zoufal Aurelien Lucchi Alessio Figalli Stefan Woerner 166 770 0 30 Oct 2020
Compressive Sensing and Neural Networks from a Statistical Learning Perspective Arash Behboodi Holger Rauhut Ekkehard Schnoor 103 19 0 29 Oct 2020