v1v2v3 (latest)

An Empirical Study of Example Forgetting during Deep Neural Network Learning

12 December 2018

Mariya Toneva

Alessandro Sordoni

Rémi Tachet des Combes

Papers citing "An Empirical Study of Example Forgetting during Deep Neural Network Learning"

50 / 496 papers shown

Title
Bitrate-Constrained DRO: Beyond Worst Case Robustness To Unknown Group Shifts Amrith Rajagopal Setlur D. Dennis Benjamin Eysenbach Aditi Raghunathan Chelsea Finn Virginia Smith Sergey Levine OOD 62 11 0 06 Feb 2023
Generalized Uncertainty of Deep Neural Networks: Taxonomy and Applications Chengyu Dong OOD UQCV BDL AI4CE 116 0 0 02 Feb 2023
Learning Large-scale Neural Fields via Context Pruned Meta-Learning Jihoon Tack Subin Kim Sihyun Yu Jaeho Lee Jinwoo Shin Jonathan Richard Schwarz 87 9 0 01 Feb 2023
A Mathematical Model for Curriculum Learning for Parities Elisabetta Cornacchia Elchanan Mossel 70 11 0 31 Jan 2023
MILO: Model-Agnostic Subset Selection Framework for Efficient Model Training and Tuning Krishnateja Killamsetty A. Evfimievski Tejaswini Pedapati K. Kate Lucian Popa Rishabh K. Iyer 51 8 0 30 Jan 2023
Neural Relation Graph: A Unified Framework for Identifying Label Noise and Outlier Data Jang-Hyun Kim Sangdoo Yun Hyun Oh Song 71 19 0 29 Jan 2023
Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers Sungmin Cha Sungjun Cho Dasol Hwang Honglak Lee Taesup Moon Moontae Lee MU 151 42 0 27 Jan 2023
Backward Compatibility During Data Updates by Weight Interpolation Raphael Schumann Elman Mansimov Yi-An Lai Nikolaos Pappas Xibin Gao Yi Zhang 41 5 0 25 Jan 2023
Forgetful Active Learning with Switch Events: Efficient Sampling for Out-of-Distribution Data Ryan Benkert Mohit Prabhushankar Ghassan AlRegib OODD OOD 65 9 0 12 Jan 2023
Data Distillation: A Survey Noveen Sachdeva Julian McAuley DD 92 78 0 11 Jan 2023
Explaining Deep Models through Forgettable Learning Dynamics Ryan Benkert Oluwaseun Joseph Aribido Ghassan AlRegib FAtt 43 9 0 10 Jan 2023
Data Valuation Without Training of a Model Nohyun Ki Hoyong Choi Hye Won Chung TDI 82 33 0 03 Jan 2023
When Do Curricula Work in Federated Learning? Saeed Vahidian Sreevatsank Kadaveru Woo-Ram Baek Weijia Wang Vyacheslav Kungurtsev Chong Chen M. Shah Bill Lin FedML 88 11 0 24 Dec 2022
On-the-fly Denoising for Data Augmentation in Natural Language Understanding Tianqing Fang Wenxuan Zhou Fangyu Liu Hongming Zhang Yangqiu Song Muhao Chen 106 1 0 20 Dec 2022
Calibrating Deep Neural Networks using Explicit Regularisation and Dynamic Data Pruning R. Hebbalaguppe Rishabh Patra T. Dash Gautam M. Shroff Lovekesh Vig 74 15 0 20 Dec 2022
DSI++: Updating Transformer Memory with New Documents Sanket Vaibhav Mehta Jai Gupta Yi Tay Mostafa Dehghani Vinh Q. Tran J. Rao Marc Najork Emma Strubell Donald Metzler CLL 91 45 0 19 Dec 2022
Learning from Training Dynamics: Identifying Mislabeled Data Beyond Manually Designed Features Qingrui Jia Xuhong Li Lei Yu Jiang Bian Penghao Zhao Shupeng Li Haoyi Xiong Dejing Dou NoLa 76 5 0 19 Dec 2022
Simplicity Bias Leads to Amplified Performance Disparities Samuel J. Bell Levent Sagun 46 13 0 13 Dec 2022
Federated Few-Shot Learning for Mobile NLP Dongqi Cai Shangguang Wang Yaozong Wu F. Lin Mengwei Xu FedML 86 12 0 12 Dec 2022
Task Discovery: Finding the Tasks that Neural Networks Generalize on Andrei Atanov Andrei Filatov Teresa Yeo Ajay Sohmshetty Amir Zamir OOD 132 10 0 01 Dec 2022
Deep Learning on a Healthy Data Diet: Finding Important Examples for Fairness A. Zayed Prasanna Parthasarathi Gonçalo Mordido Hamid Palangi Samira Shabanian Sarath Chandar 54 22 0 20 Nov 2022
Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training Zhenglun Kong Haoyu Ma Geng Yuan Mengshu Sun Yanyue Xie ... Tianlong Chen Xiaolong Ma Xiaohui Xie Zhangyang Wang Yanzhi Wang ViT 112 24 0 19 Nov 2022
Mechanistic Mode Connectivity Ekdeep Singh Lubana Eric J. Bigelow Robert P. Dick David M. Krueger Hidenori Tanaka 118 49 0 15 Nov 2022
What Images are More Memorable to Machines? Junlin Han Huangying Zhan Jie Hong Pengfei Fang Hongdong Li L. Petersson Ian Reid 71 3 0 14 Nov 2022
BERT on a Data Diet: Finding Important Examples by Gradient-Based Pruning Mohsen Fayyaz Ehsan Aghazadeh Ali Modarressi Mohammad Taher Pilehvar Yadollah Yaghoobzadeh Samira Ebrahimi Kahou 60 18 0 10 Nov 2022
Private Set Generation with Discriminative Information Dingfan Chen Raouf Kerkouche Mario Fritz DD 80 39 0 07 Nov 2022
Black-box Coreset Variational Inference Dionysis Manousakas H. Ritter Theofanis Karaletsos BDL 56 4 0 04 Nov 2022
Reduce, Reuse, Recycle: Improving Training Efficiency with Distillation Cody Blakeney Jessica Zosa Forde Jonathan Frankle Ziliang Zong Matthew L. Leavitt VLM 81 5 0 01 Nov 2022
Dataset Distillation via Factorization Songhua Liu Kai Wang Xingyi Yang Jingwen Ye Xinchao Wang DD 217 146 0 30 Oct 2022
Coverage-centric Coreset Selection for High Pruning Rates Haizhong Zheng Rui Liu Fan Lai Atul Prakash 84 63 0 28 Oct 2022
Federated Continual Learning to Detect Accounting Anomalies in Financial Auditing Marco Schreyer Hamed Hemati Damian Borth M. Vasarhelyi FedML 91 3 0 26 Oct 2022
Characterizing Datapoints via Second-Split Forgetting Pratyush Maini Saurabh Garg Zachary Chase Lipton J. Zico Kolter 82 34 0 26 Oct 2022
Pruning's Effect on Generalization Through the Lens of Training and Regularization Tian Jin Michael Carbin Daniel M. Roy Jonathan Frankle Gintare Karolina Dziugaite 84 30 0 25 Oct 2022
Efficient Dataset Distillation Using Random Feature Approximation Noel Loo Ramin Hasani Alexander Amini Daniela Rus DD 129 99 0 21 Oct 2022
A Survey of Dataset Refinement for Problems in Computer Vision Datasets Zhijing Wan Zhixiang Wang CheukTing Chung Zheng Wang 80 10 0 21 Oct 2022
Improving Data Quality with Training Dynamics of Gradient Boosting Decision Trees M. Ponti L. Oliveira Mathias Esteban Valentina Garcia J. Román Luis Argerich TDI 80 4 0 20 Oct 2022
Noise Audits Improve Moral Foundation Classification Negar Mokhberian F. R. Hopp Bahareh Harandizadeh Fred Morstatter Kristina Lerman NoLa 82 7 0 13 Oct 2022
TiDAL: Learning Training Dynamics for Active Learning Seong Min Kye Kwanghee Choi Hyeongmin Byun Buru Chang 89 14 0 13 Oct 2022
Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities Brian Bartoldson B. Kailkhura Davis W. Blalock 107 50 0 13 Oct 2022
Is your noise correction noisy? PLS: Robustness to label noise with two stage detection Paul Albert Eric Arazo Tarun Kirshna Noel E. O'Connor Kevin McGuinness NoLa 78 16 0 10 Oct 2022
Dataset Distillation Using Parameter Pruning Guang Li Ren Togo Takahiro Ogawa Miki Haseyama DD 134 22 0 29 Sep 2022
Quantification before Selection: Active Dynamics Preference for Robust Reinforcement Learning Kang Xu Yan Ma Wei Li 97 0 0 23 Sep 2022
Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training Geng Yuan Yanyu Li Sheng Li Zhenglun Kong Sergey Tulyakov Xulong Tang Yanzhi Wang Jian Ren 81 16 0 22 Sep 2022
Deep Double Descent via Smooth Interpolation Matteo Gamba Erik Englesson Mårten Björkman Hossein Azizpour 169 11 0 21 Sep 2022
SparCL: Sparse Continual Learning on the Edge Zifeng Wang Zheng Zhan Yifan Gong Geng Yuan Wei Niu T. Jian Bin Ren Stratis Ioannidis Yanzhi Wang Jennifer Dy CLL 124 63 0 20 Sep 2022
Lazy vs hasty: linearization in deep networks impacts learning schedule based on example difficulty Thomas George Guillaume Lajoie A. Baratin 87 6 0 19 Sep 2022
UMIX: Improving Importance Weighting for Subpopulation Shift via Uncertainty-Aware Mixup Zongbo Han Zhipeng Liang Fan Yang Liu Liu Lanqing Li Yatao Bian P. Zhao Bing Wu Changqing Zhang Jianhua Yao 112 36 0 19 Sep 2022
Membership Inference Attacks by Exploiting Loss Trajectory Yiyong Liu Zhengyu Zhao Michael Backes Yang Zhang 99 111 0 31 Aug 2022
Achieving Fairness in Dermatological Disease Diagnosis through Automatic Weight Adjusting Federated Learning and Personalization Gelei Xu Yawen Wu Jingtong Hu Yiyu Shi FedML 72 3 0 23 Aug 2022
Dataset Condensation with Latent Space Knowledge Factorization and Sharing Haebeom Lee Dong Bok Lee Sung Ju Hwang DD 71 38 0 21 Aug 2022