Characterizing Datapoints via Second-Split Forgetting

26 October 2022

Pratyush Maini

Saurabh Garg

Zachary Chase Lipton

J. Zico Kolter

ArXiv (abs)PDF HTML Github (15★)

Papers citing "Characterizing Datapoints via Second-Split Forgetting"

26 / 26 papers shown

Title
Early Stopping Against Label Noise Without Validation Data Suqin Yuan Lei Feng Tongliang Liu NoLa 270 19 0 11 Feb 2025
Uncovering Memorization Effect in the Presence of Spurious Correlations Chenyu You Haocheng Dai Yifei Min Jasjeet Sekhon S. Joshi James S. Duncan 139 3 0 01 Jan 2025
Memorize to Generalize: on the Necessity of Interpolation in High Dimensional Linear Regression Chen Cheng John C. Duchi Rohith Kuditipudi 47 12 0 20 Feb 2022
Simple data balancing achieves competitive worst-group-accuracy Badr Youbi Idrissi Martín Arjovsky Mohammad Pezeshki David Lopez-Paz 118 183 0 27 Oct 2021
Deep Learning Through the Lens of Example Difficulty R. Baldock Hartmut Maennel Behnam Neyshabur 85 161 0 17 Jun 2021
RATT: Leveraging Unlabeled Data to Guarantee Generalization Saurabh Garg Sivaraman Balakrishnan J. Zico Kolter Zachary Chase Lipton 77 30 0 01 May 2021
Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning Zeyuan Allen-Zhu Yuanzhi Li FedML 151 376 0 17 Dec 2020
When is Memorization of Irrelevant Training Data Necessary for High-Accuracy Learning? Gavin Brown Mark Bun Vitaly Feldman Adam D. Smith Kunal Talwar 311 100 0 11 Dec 2020
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 225 470 0 09 Aug 2020
Early-Learning Regularization Prevents Memorization of Noisy Labels Sheng Liu Jonathan Niles-Weed N. Razavian C. Fernandez‐Granda NoLa 106 569 0 30 Jun 2020
The Pitfalls of Simplicity Bias in Neural Networks Harshay Shah Kaustav Tamuly Aditi Raghunathan Prateek Jain Praneeth Netrapalli AAML 72 364 0 13 Jun 2020
Finite-sample Analysis of Interpolating Linear Classifiers in the Overparameterized Regime Niladri S. Chatterji Philip M. Long 83 109 0 25 Apr 2020
DivideMix: Learning with Noisy Labels as Semi-supervised Learning Junnan Li R. Socher Guosheng Lin NoLa 110 1,034 0 18 Feb 2020
Characterizing Structural Regularities of Labeled Data in Overparameterized Models Ziheng Jiang Chiyuan Zhang Kunal Talwar Michael C. Mozer TDI 61 104 0 08 Feb 2020
Identifying Mislabeled Data using the Area Under the Margin Ranking Geoff Pleiss Tianyi Zhang Ethan R. Elenberg Kilian Q. Weinberger NoLa 94 274 0 28 Jan 2020
Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov Lucas Beyer Xiaohua Zhai J. Puigcerver Jessica Yung Sylvain Gelly N. Houlsby MQ 288 1,211 0 24 Dec 2019
Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization Shiori Sagawa Pang Wei Koh Tatsunori B. Hashimoto Percy Liang OOD 108 1,249 0 20 Nov 2019
Confident Learning: Estimating Uncertainty in Dataset Labels Curtis G. Northcutt Lu Jiang Isaac L. Chuang NoLa 197 703 0 31 Oct 2019
Distribution Density, Tails, and Outliers in Machine Learning: Metrics and Applications Nicholas Carlini Ulfar Erlingsson Nicolas Papernot OOD OODD 60 61 0 29 Oct 2019
Does Learning Require Memorization? A Short Tale about a Long Tail Vitaly Feldman TDI 142 502 0 12 Jun 2019
Understanding and Utilizing Deep Neural Networks Trained with Noisy Labels Pengfei Chen B. Liao Guangyong Chen Shengyu Zhang NoLa 80 388 0 13 May 2019
An Empirical Study of Example Forgetting during Deep Neural Network Learning Mariya Toneva Alessandro Sordoni Rémi Tachet des Combes Adam Trischler Yoshua Bengio Geoffrey J. Gordon 134 741 0 12 Dec 2018
A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay L. Smith 286 1,035 0 26 Mar 2018
A Closer Look at Memorization in Deep Networks Devansh Arpit Stanislaw Jastrzebski Nicolas Ballas David M. Krueger Emmanuel Bengio ... Tegan Maharaj Asja Fischer Aaron Courville Yoshua Bengio Simon Lacoste-Julien TDI 131 1,829 0 16 Jun 2017
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks Alec Radford Luke Metz Soumith Chintala GAN OOD 294 14,032 0 19 Nov 2015
Deep Learning Face Attributes in the Wild Ziwei Liu Ping Luo Xiaogang Wang Xiaoou Tang CVBM 257 8,433 0 28 Nov 2014