Understanding deep learning requires rethinking generalization

10 November 2016

Benjamin Recht

Papers citing "Understanding deep learning requires rethinking generalization"

50 / 1,031 papers shown

Title
Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooring Yossi Adi Carsten Baum Moustapha Cissé Benny Pinkas Joseph Keshet 15 669 0 13 Feb 2018
Deep Neural Networks Learn Non-Smooth Functions Effectively Masaaki Imaizumi Kenji Fukumizu 23 123 0 13 Feb 2018
Towards Understanding the Generalization Bias of Two Layer Convolutional Linear Classifiers with Gradient Descent Yifan Wu Barnabás Póczós Aarti Singh MLT 30 8 0 13 Feb 2018
Learning Compact Neural Networks with Regularization Samet Oymak MLT 41 39 0 05 Feb 2018
Semi-Supervised Convolutional Neural Networks for Human Activity Recognition Mingzhi Zeng Tong Yu Tianlin Li Le T. Nguyen Ole J. Mengshoel Ian Lane SSL HAI 11 62 0 22 Jan 2018
Faster gaze prediction with dense networks and Fisher pruning Lucas Theis I. Korshunova Alykhan Tejani Ferenc Huszár 34 204 0 17 Jan 2018
Fix your classifier: the marginal value of training the last weight layer Elad Hoffer Itay Hubara Daniel Soudry 35 101 0 14 Jan 2018
Approximation beats concentration? An approximation view on inference with smooth radial kernels M. Belkin 39 69 0 10 Jan 2018
Boundary Optimizing Network (BON) Marco Singh A. Pai 27 0 0 08 Jan 2018
Theory of Deep Learning IIb: Optimization Properties of SGD Chiyuan Zhang Q. Liao Alexander Rakhlin Brando Miranda Noah Golowich T. Poggio ODL 28 71 0 07 Jan 2018
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 111 1,850 0 28 Dec 2017
Entropy-SGD optimizes the prior of a PAC-Bayes bound: Generalization properties of Entropy-SGD and data-dependent priors Gintare Karolina Dziugaite Daniel M. Roy MLT 30 144 0 26 Dec 2017
Spurious Local Minima are Common in Two-Layer ReLU Neural Networks Itay Safran Ohad Shamir 40 262 0 24 Dec 2017
Improving Generalization Performance by Switching from Adam to SGD N. Keskar R. Socher ODL 41 521 0 20 Dec 2017
Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning Xinyun Chen Chang-rui Liu Bo-wen Li Kimberly Lu D. Song AAML SILM 44 1,805 0 15 Dec 2017
A trans-disciplinary review of deep learning research for water resources scientists Chaopeng Shen AI4CE 33 682 0 06 Dec 2017
Deep Learning Scaling is Predictable, Empirically Joel Hestness Sharan Narang Newsha Ardalani G. Diamos Heewoo Jun Hassan Kianinejad Md. Mostofa Ali Patwary Yang Yang Yanqi Zhou 63 716 0 01 Dec 2017
Providing theoretical learning guarantees to Deep Learning Networks R. Mello M. D. Ferreira M. Ponti 28 6 0 28 Nov 2017
Invariance of Weight Distributions in Rectified MLPs Russell Tsuchida Farbod Roosta-Khorasani M. Gallagher MLT 32 35 0 24 Nov 2017
Sparse-Input Neural Networks for High-dimensional Nonparametric Regression and Classification Jean Feng N. Simon 24 99 0 21 Nov 2017
Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs S. Shi Qiang-qiang Wang Xiaowen Chu 37 110 0 16 Nov 2017
Interpreting Deep Visual Representations via Network Dissection Bolei Zhou David Bau A. Oliva Antonio Torralba FAtt MILM 29 323 0 15 Nov 2017
Three Factors Influencing Minima in SGD Stanislaw Jastrzebski Zachary Kenton Devansh Arpit Nicolas Ballas Asja Fischer Yoshua Bengio Amos Storkey 42 457 0 13 Nov 2017
Intriguing Properties of Adversarial Examples E. D. Cubuk Barret Zoph S. Schoenholz Quoc V. Le AAML 31 84 0 08 Nov 2017
Fixing a Broken ELBO Alexander A. Alemi Ben Poole Ian S. Fischer Joshua V. Dillon Rif A. Saurous Kevin Patrick Murphy DRL BDL 39 80 0 01 Nov 2017
SGD Learns Over-parameterized Networks that Provably Generalize on Linearly Separable Data Alon Brutzkus Amir Globerson Eran Malach Shai Shalev-Shwartz MLT 50 276 0 27 Oct 2017
Rethinking generalization requires revisiting old ideas: statistical mechanics approaches and complex learning behavior Charles H. Martin Michael W. Mahoney AI4CE 30 62 0 26 Oct 2017
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 93 9,610 0 25 Oct 2017
Learning Differentially Private Recurrent Language Models H. B. McMahan Daniel Ramage Kunal Talwar Li Zhang FedML 27 125 0 18 Oct 2017
Combining Learned and Analytical Models for Predicting Action Effects from Sensory Data Alina Kloss S. Schaal Jeannette Bohg 40 85 0 11 Oct 2017
High-dimensional dynamics of generalization error in neural networks Madhu S. Advani Andrew M. Saxe AI4CE 90 464 0 10 Oct 2017
Function space analysis of deep learning representation layers Oren Elisha S. Dekel 30 4 0 09 Oct 2017
Machine Learning Models that Remember Too Much Congzheng Song Thomas Ristenpart Vitaly Shmatikov VLM 36 505 0 22 Sep 2017
Neural Optimizer Search with Reinforcement Learning Irwan Bello Barret Zoph Vijay Vasudevan Quoc V. Le ODL 29 383 0 21 Sep 2017
Reversible Architectures for Arbitrarily Deep Residual Neural Networks B. Chang Lili Meng E. Haber Lars Ruthotto David Begert E. Holtham AI4CE 33 261 0 12 Sep 2017
Privacy Risk in Machine Learning: Analyzing the Connection to Overfitting Samuel Yeom Irene Giacomelli Matt Fredrikson S. Jha MIACV 26 39 0 05 Sep 2017
Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates L. Smith Nicholay Topin AI4CE 39 519 0 23 Aug 2017
Machine learning for neural decoding Joshua I. Glaser Ari S. Benjamin Raeed H. Chowdhury M. Perich L. Miller Konrad Paul Kording 33 242 0 02 Aug 2017
Mini-batch Tempered MCMC Dangna Li W. Wong 29 5 0 31 Jul 2017
Optimizing the Latent Space of Generative Networks Piotr Bojanowski Armand Joulin David Lopez-Paz Arthur Szlam GAN 33 412 0 18 Jul 2017
Theoretical insights into the optimization landscape of over-parameterized shallow neural networks Mahdi Soltanolkotabi Adel Javanmard J. Lee 36 415 0 16 Jul 2017
Context Aware Document Embedding Zhaocheng Zhu Junfeng Hu 38 9 0 05 Jul 2017
Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems J. C. Ye Yoseob Han Eunju Cha 36 16 0 03 Jul 2017
Optimization Methods for Supervised Machine Learning: From Linear Models to Deep Learning Frank E. Curtis K. Scheinberg 39 45 0 30 Jun 2017
Exploring Generalization in Deep Learning Behnam Neyshabur Srinadh Bhojanapalli David A. McAllester Nathan Srebro FAtt 104 1,237 0 27 Jun 2017
Gabor frames and deep scattering networks in audio processing Roswitha Bammer M. Dörfler Pavol Harar 16 7 0 27 Jun 2017
Spectrally-normalized margin bounds for neural networks Peter L. Bartlett Dylan J. Foster Matus Telgarsky ODL 77 1,202 0 26 Jun 2017
Collaborative Deep Learning in Fixed Topology Networks Zhanhong Jiang Aditya Balu C. Hegde S. Sarkar FedML 32 179 0 23 Jun 2017
GM-Net: Learning Features with More Efficiency Yujia Chen Ce Li 24 6 0 21 Jun 2017
Recovery Guarantees for One-hidden-layer Neural Networks Kai Zhong Zhao Song Prateek Jain Peter L. Bartlett Inderjit S. Dhillon MLT 34 336 0 10 Jun 2017