Rethinking generalization requires revisiting old ideas: statistical mechanics approaches and complex learning behavior

26 October 2017

Papers citing "Rethinking generalization requires revisiting old ideas: statistical mechanics approaches and complex learning behavior"

19 / 19 papers shown

Title
A Model Zoo on Phase Transitions in Neural Networks Konstantin Schurholt Léo Meynent Yefan Zhou Haiquan Lu Yaoqing Yang Damian Borth 68 0 0 25 Apr 2025
Towards Scalable and Versatile Weight Space Learning Konstantin Schurholt Michael W. Mahoney Damian Borth 50 15 0 14 Jun 2024
When are ensembles really effective? Ryan Theisen Hyunsuk Kim Yaoqing Yang Liam Hodgkinson Michael W. Mahoney FedML UQCV 35 15 0 21 May 2023
On the Overlooked Structure of Stochastic Gradients Zeke Xie Qian-Yuan Tang Mingming Sun P. Li 31 6 0 05 Dec 2022
Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data Yaoqing Yang Ryan Theisen Liam Hodgkinson Joseph E. Gonzalez Kannan Ramchandran Charles H. Martin Michael W. Mahoney 88 17 0 06 Feb 2022
On Random Matrices Arising in Deep Neural Networks: General I.I.D. Case L. Pastur V. Slavin CML 24 12 0 20 Nov 2020
Unsupervised Low-light Image Enhancement with Decoupled Networks Wei Xiong Ding Liu Xiaohui Shen Chen Fang Jiebo Luo 26 19 0 06 May 2020
Predicting trends in the quality of state-of-the-art neural networks without access to training or testing data Charles H. Martin Tongsu Peng Peng Michael W. Mahoney 36 101 0 17 Feb 2020
Towards Efficient Training for Neural Network Quantization Qing Jin Linjie Yang Zhenyu A. Liao MQ 13 42 0 21 Dec 2019
Deep learning with noisy labels: exploring techniques and remedies in medical image analysis Davood Karimi Haoran Dou Simon K. Warfield Ali Gholipour NoLa 18 535 0 05 Dec 2019
Traditional and Heavy-Tailed Self Regularization in Neural Network Models Charles H. Martin Michael W. Mahoney 21 119 0 24 Jan 2019
Parameter Re-Initialization through Cyclical Batch Size Schedules Norman Mu Z. Yao A. Gholami Kurt Keutzer Michael W. Mahoney ODL 30 8 0 04 Dec 2018
Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning Charles H. Martin Michael W. Mahoney AI4CE 35 190 0 02 Oct 2018
Toward Convolutional Blind Denoising of Real Photographs Shi Guo Zifei Yan Peng Sun W. Zuo Lei Zhang 35 899 0 12 Jul 2018
The committee machine: Computational to statistical gaps in learning a two-layers neural network Benjamin Aubin Antoine Maillard Jean Barbier Florent Krzakala N. Macris Lenka Zdeborová 41 104 0 14 Jun 2018
Invariance of Weight Distributions in Rectified MLPs Russell Tsuchida Farbod Roosta-Khorasani M. Gallagher MLT 32 35 0 24 Nov 2017
Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Models Jean Barbier Florent Krzakala N. Macris Léo Miolane Lenka Zdeborová 25 259 0 10 Aug 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,890 0 15 Sep 2016
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 183 1,185 0 30 Nov 2014