Dataset Difficulty and the Role of Inductive Bias

Dataset Difficulty and the Role of Inductive Bias

3 January 2024

Jonathan Frankle

Gintare Karolina Dziugaite

Papers citing "Dataset Difficulty and the Role of Inductive Bias"

13 / 13 papers shown

Title
Metadata Archaeology: Unearthing Data Subsets by Leveraging Training Dynamics Shoaib Ahmed Siddiqui Nitarshan Rajkumar Tegan Maharaj David M. Krueger Sara Hooker 98 27 0 20 Sep 2022
Beyond neural scaling laws: beating power law scaling via data pruning Ben Sorscher Robert Geirhos Shashank Shekhar Surya Ganguli Ari S. Morcos 85 439 0 29 Jun 2022
Understanding Memorization from the Perspective of Optimization via Efficient Influence Estimation Futong Liu Tao R. Lin Martin Jaggi TDI 41 8 0 16 Dec 2021
Deep Learning on a Data Diet: Finding Important Examples Early in Training Mansheej Paul Surya Ganguli Gintare Karolina Dziugaite 105 457 0 15 Jul 2021
Deep Learning Through the Lens of Example Difficulty R. Baldock Hartmut Maennel Behnam Neyshabur 72 160 0 17 Jun 2021
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 140 462 0 09 Aug 2020
Estimating Training Data Influence by Tracing Gradient Descent G. Pruthi Frederick Liu Mukund Sundararajan Satyen Kale TDI 72 407 0 19 Feb 2020
Characterizing Structural Regularities of Labeled Data in Overparameterized Models Ziheng Jiang Chiyuan Zhang Kunal Talwar Michael C. Mozer TDI 56 102 0 08 Feb 2020
Identifying Mislabeled Data using the Area Under the Margin Ranking Geoff Pleiss Tianyi Zhang Ethan R. Elenberg Kilian Q. Weinberger NoLa 81 272 0 28 Jan 2020
Confident Learning: Estimating Uncertainty in Dataset Labels Curtis G. Northcutt Lu Jiang Isaac L. Chuang NoLa 131 691 0 31 Oct 2019
Accelerating Deep Learning by Focusing on the Biggest Losers Angela H. Jiang Daniel L.-K. Wong Giulio Zhou D. Andersen J. Dean ... Gauri Joshi M. Kaminsky M. Kozuch Zachary Chase Lipton Padmanabhan Pillai 58 121 0 02 Oct 2019
An Empirical Study of Example Forgetting during Deep Neural Network Learning Mariya Toneva Alessandro Sordoni Rémi Tachet des Combes Adam Trischler Yoshua Bengio Geoffrey J. Gordon 107 733 0 12 Dec 2018
Predicting the Generalization Gap in Deep Networks with Margin Distributions Yiding Jiang Dilip Krishnan H. Mobahi Samy Bengio UQCV 85 199 0 28 Sep 2018