v1v2 (latest)

What Do Neural Networks Learn When Trained With Random Labels?

18 June 2020

Hartmut Maennel

Ibrahim Alabdulmohsin

Papers citing "What Do Neural Networks Learn When Trained With Random Labels?"

39 / 39 papers shown

Title
Supervised Models Can Generalize Also When Trained on Random Labels Oskar Allerbo Thomas B. Schön OOD SSL 94 0 0 16 May 2025
Partitioned Neural Network Training via Synthetic Intermediate Labels C. V. Karadag Nezih Topaloglu 77 1 0 17 Mar 2024
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 826 42,332 0 28 May 2020
The Early Phase of Neural Network Training Jonathan Frankle D. Schwab Ari S. Morcos 87 174 0 24 Feb 2020
Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov Lucas Beyer Xiaohua Zhai J. Puigcerver Jessica Yung Sylvain Gelly N. Houlsby MQ 286 1,211 0 24 Dec 2019
Neural Network Memorization Dissection Jindong Gu Volker Tresp FedML 52 12 0 21 Nov 2019
Intrinsic dimension of data representations in deep neural networks A. Ansuini Alessandro Laio Jakob H. Macke D. Zoccolan AI4CE 78 279 0 29 May 2019
Network Deconvolution Chengxi Ye Matthew Evanusa Hua He A. Mitrokhin Tom Goldstein J. Yorke Cornelia Fermuller Yiannis Aloimonos 43 34 0 28 May 2019
Transfusion: Understanding Transfer Learning for Medical Imaging M. Raghu Chiyuan Zhang Jon M. Kleinberg Samy Bengio MedIm 77 985 0 14 Feb 2019
Why ReLU Units Sometimes Die: Analysis of Single-Unit Error Backpropagation in Neural Networks S. Douglas Jiutian Yu 38 45 0 14 Dec 2018
Leveraging Random Label Memorization for Unsupervised Pre-Training Vinaychandran Pondenkandath Michele Alberti Sammer Puran Rolf Ingold Marcus Liwicki NoLa 107 14 0 05 Nov 2018
Detecting Memorization in ReLU Networks Edo Collins Siavash Bigdeli Sabine Süsstrunk 67 4 0 08 Oct 2018
Mean Field Analysis of Neural Networks: A Central Limit Theorem Justin A. Sirignano K. Spiliopoulos MLT 75 194 0 28 Aug 2018
Collapse of Deep and Narrow Neural Nets Lu Lu Yanhui Su George Karniadakis ODL 68 156 0 15 Aug 2018
Dimensionality-Driven Learning with Noisy Labels Xingjun Ma Yisen Wang Michael E. Houle Shuo Zhou S. Erfani Shutao Xia S. Wijewickrema James Bailey NoLa 78 434 0 07 Jun 2018
Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels Zhilu Zhang M. Sabuncu NoLa 85 2,608 0 20 May 2018
DNN or k-NN: That is the Generalize vs. Memorize Question Gilad Cohen Guillermo Sapiro Raja Giryes 44 38 0 17 May 2018
Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels Bo Han Quanming Yao Xingrui Yu Gang Niu Miao Xu Weihua Hu Ivor Tsang Masashi Sugiyama NoLa 115 2,078 0 18 Apr 2018
Group Normalization Yuxin Wu Kaiming He 233 3,669 0 22 Mar 2018
Sensitivity and Generalization in Neural Networks: an Empirical Study Roman Novak Yasaman Bahri Daniel A. Abolafia Jeffrey Pennington Jascha Narain Sohl-Dickstein AAML 93 441 0 23 Feb 2018
MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels Lu Jiang Zhengyuan Zhou Thomas Leung Li Li Li Fei-Fei NoLa 106 1,456 0 14 Dec 2017
Exploring Generalization in Deep Learning Behnam Neyshabur Srinadh Bhojanapalli David A. McAllester Nathan Srebro FAtt 150 1,258 0 27 Jun 2017
Spectrally-normalized margin bounds for neural networks Peter L. Bartlett Dylan J. Foster Matus Telgarsky ODL 207 1,224 0 26 Jun 2017
A Closer Look at Memorization in Deep Networks Devansh Arpit Stanislaw Jastrzebski Nicolas Ballas David M. Krueger Emmanuel Bengio ... Tegan Maharaj Asja Fischer Aaron Courville Yoshua Bengio Simon Lacoste-Julien TDI 125 1,823 0 16 Jun 2017
Learning from Noisy Labels with Distillation Yuncheng Li Jianchao Yang Yale Song Liangliang Cao Jiebo Luo Li Li NoLa 80 550 0 07 Mar 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 345 4,629 0 10 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 427 2,945 0 15 Sep 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 349 7,995 0 23 May 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 354 10,192 0 16 Mar 2016
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 300 5,532 0 23 Nov 2015
A PCA-Based Convolutional Network Yanhai Gan Jun Liu Junyu Dong G. Zhong SSL 55 13 0 14 May 2015
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 292 590 0 27 Feb 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,328 0 11 Feb 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 326 18,647 0 06 Feb 2015
How transferable are features in deep neural networks? J. Yosinski Jeff Clune Yoshua Bengio Hod Lipson OOD 234 8,344 0 06 Nov 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.7K 100,479 0 04 Sep 2014
Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks Alexey Dosovitskiy Philipp Fischer Jost Tobias Springenberg Martin Riedmiller Thomas Brox OOD SSL 87 1,022 0 26 Jun 2014
Training Convolutional Networks with Noisy Labels Sainbayar Sukhbaatar Joan Bruna Manohar Paluri Lubomir D. Bourdev Rob Fergus NoLa 92 272 0 09 Jun 2014
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 181 1,849 0 20 Dec 2013