v1v2v3 (latest)

An Empirical Study of Example Forgetting during Deep Neural Network Learning

12 December 2018

Mariya Toneva

Alessandro Sordoni

Rémi Tachet des Combes

Papers citing "An Empirical Study of Example Forgetting during Deep Neural Network Learning"

50 / 496 papers shown

Title
DiscrimLoss: A Universal Loss for Hard Samples and Incorrect Samples Discrimination Tingting Wu Xiao Ding Hao Zhang Jin-Fang Gao Li Du Bing Qin Ting Liu 60 9 0 21 Aug 2022
Adaptive Second Order Coresets for Data-efficient Machine Learning Omead Brandon Pooladzandi David Davini Baharan Mirzasoleiman 99 65 0 28 Jul 2022
DC-BENCH: Dataset Condensation Benchmark Justin Cui Ruochen Wang Si Si Cho-Jui Hsieh DD 95 75 0 20 Jul 2022
Angular Gap: Reducing the Uncertainty of Image Difficulty through Model Calibration Bohua Peng Mobarakol Islam Mei Tu UQCV 57 9 0 18 Jul 2022
Knowledge Condensation Distillation Chenxin Li Mingbao Lin Zhiyuan Ding Nie Lin Yihong Zhuang Yue Huang Xinghao Ding Liujuan Cao 83 28 0 12 Jul 2022
Learning Robust Representation for Joint Grading of Ophthalmic Diseases via Adaptive Curriculum and Feature Disentanglement Haoxuan Che Haibo Jin Haoxing Chen OOD 98 23 0 09 Jul 2022
A Study on the Predictability of Sample Learning Consistency Alain Raymond-Sáez J. Hurtado Alvaro Soto 27 0 0 07 Jul 2022
Beyond neural scaling laws: beating power law scaling via data pruning Ben Sorscher Robert Geirhos Shashank Shekhar Surya Ganguli Ari S. Morcos 110 446 0 29 Jun 2022
BackdoorBench: A Comprehensive Benchmark of Backdoor Learning Baoyuan Wu Hongrui Chen Ruotong Wang Zihao Zhu Shaokui Wei Danni Yuan Chaoxiao Shen ELM AAML 138 146 0 25 Jun 2022
Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt Sören Mindermann J. Brauner Muhammed Razzak Mrinank Sharma Andreas Kirsch ... Benedikt Höltgen Aidan Gomez Adrien Morisot Sebastian Farquhar Y. Gal 119 164 0 14 Jun 2022
Infinite Recommendation Networks: A Data-Centric Approach Noveen Sachdeva Mehak Preet Dhaliwal Carole-Jean Wu Julian McAuley DD 110 28 0 03 Jun 2022
Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks Mansheej Paul Brett W. Larsen Surya Ganguli Jonathan Frankle Gintare Karolina Dziugaite 59 24 0 02 Jun 2022
An Empirical Study of Retrieval-enhanced Graph Neural Networks Dingmin Wang Shengchao Liu Hanchen Wang Bernardo Cuenca Grau Linfeng Song Jian Tang Song Le Qi Liu 82 0 0 01 Jun 2022
Dataset Condensation via Efficient Synthetic-Data Parameterization Jang-Hyun Kim Jinuk Kim Seong Joon Oh Sangdoo Yun Hwanjun Song Joonhyun Jeong Jung-Woo Ha Hyun Oh Song DD 518 168 0 30 May 2022
Selective Classification Via Neural Network Training Dynamics Stephan Rabanser Anvith Thudi Kimia Hamidieh Adam Dziedzic Nicolas Papernot 114 22 0 26 May 2022
VeriFi: Towards Verifiable Federated Unlearning Xiangshan Gao Xingjun Ma Jingyi Wang Youcheng Sun Bo Li S. Ji Peng Cheng Jiming Chen MU 128 48 0 25 May 2022
LOPS: Learning Order Inspired Pseudo-Label Selection for Weakly Supervised Text Classification Dheeraj Mekala Chengyu Dong Jingbo Shang 61 20 0 25 May 2022
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models Kushal Tirumala Aram H. Markosyan Luke Zettlemoyer Armen Aghajanyan TDI 122 197 0 22 May 2022
Unintended memorisation of unique features in neural networks J. Hartley Sotirios A. Tsaftaris 66 1 0 20 May 2022
Dataset Pruning: Reducing Training Data by Examining Generalization Influence Shuo Yang Zeke Xie Hanyu Peng Minjing Xu Mingming Sun P. Li DD 232 114 0 19 May 2022
Exploring the Learning Difficulty of Data Theory and Measure Weiyao Zhu Ou Wu Fengguang Su Yingjun Deng 76 6 0 16 May 2022
ELODI: Ensemble Logit Difference Inhibition for Positive-Congruent Training Yue Zhao Yantao Shen Yuanjun Xiong Shuo Yang Wei Xia Zhuowen Tu Bernt Shiele Stefano Soatto BDL 90 6 0 12 May 2022
Task-specific Compression for Multi-task Language Models using Attribution-based Pruning Nakyeong Yang Yunah Jang Hwanhee Lee Seohyeong Jung Kyomin Jung 28 8 0 09 May 2022
Learning from Pixel-Level Noisy Label : A New Perspective for Light Field Saliency Detection Mingtao Feng Li-Yu Daisy Liu Liangkai Zhang Hongshan Yu Yaonan Wang Ajmal Mian 64 18 0 28 Apr 2022
Data-Efficient Backdoor Attacks Pengfei Xia Ziqiang Li Wei Zhang Bin Li AAML FedML 45 32 0 22 Apr 2022
DeepCore: A Comprehensive Library for Coreset Selection in Deep Learning Chengcheng Guo B. Zhao Yanbing Bai OOD 139 143 0 18 Apr 2022
A Comprehensive Survey on Data-Efficient GANs in Image Generation Ziqiang Li Beihao Xia Jing Zhang Chaoyue Wang Bin Li 86 34 0 18 Apr 2022
Q-TART: Quickly Training for Adversarial Robustness and in-Transferability Madan Ravi Ganesh Salimeh Yasaei Sekeh Jason J. Corso AAML 33 1 0 14 Apr 2022
Few-shot Learning with Noisy Labels Kevin J. Liang Samrudhdhi B. Rangrej Vladan Petrovic Tal Hassner NoLa 79 50 0 12 Apr 2022
Understanding out-of-distribution accuracies through quantifying difficulty of test samples Berfin Simsek Melissa Hall Levent Sagun 62 5 0 28 Mar 2022
An Empirical Study of Memorization in NLP Xiaosen Zheng Jing Jiang TDI 83 25 1 23 Mar 2022
Dataset Distillation by Matching Training Trajectories George Cazenavette Tongzhou Wang Antonio Torralba Alexei A. Efros Jun-Yan Zhu FedML DD 190 395 0 22 Mar 2022
Representative Subset Selection for Efficient Fine-Tuning in Self-Supervised Speech Recognition Abdul Hameed Azeemi I. Qazi Agha Ali Raza 101 2 0 18 Mar 2022
Layer Ensembles: A Single-Pass Uncertainty Estimation in Deep Learning for Segmentation Kaisar Kushibar Víctor M. Campello Lidia Garrucho Moras Akis Linardos Petia Radeva Karim Lekadir UQCV 53 18 0 16 Mar 2022
Reducing Flipping Errors in Deep Neural Networks Xiang Deng Yun Xiao Bo Long Zhongfei Zhang AAML 44 4 0 16 Mar 2022
Feeding What You Need by Understanding What You Learned Xiaoqiang Wang Bang Liu Fangli Xu Bowei Long Siliang Tang Lingfei Wu 81 6 0 05 Mar 2022
CAFE: Learning to Condense Dataset by Aligning Features Kai Wang Bo Zhao Xiangyu Peng Zheng Zhu Shuo Yang Shuo Wang Guan Huang Hakan Bilen Xinchao Wang Yang You DD 72 0 0 03 Mar 2022
Adaptive Discriminative Regularization for Visual Classification Qingsong Zhao Yi Wang Shuguang Dou Chen Gong Yin Wang Cairong Zhao 90 0 0 02 Mar 2022
Deconstructing Distributions: A Pointwise Framework of Learning Gal Kaplun Nikhil Ghosh Saurabh Garg Boaz Barak Preetum Nakkiran OOD 87 21 0 20 Feb 2022
Measuring Unintended Memorisation of Unique Private Features in Neural Networks J. Hartley Sotirios A. Tsaftaris 72 9 0 16 Feb 2022
Predicting on the Edge: Identifying Where a Larger Model Does Better Taman Narayan Heinrich Jiang Sen Zhao Surinder Kumar 72 7 0 15 Feb 2022
A Lagrangian Duality Approach to Active Learning Juan Elenter Navid Naderializadeh Alejandro Ribeiro 58 23 0 08 Feb 2022
Measuring and Reducing Model Update Regression in Structured Prediction for NLP Deng Cai Elman Mansimov Yi-An Lai Yixuan Su Lei Shu Yi Zhang KELM 108 9 0 07 Feb 2022
FORML: Learning to Reweight Data for Fairness Bobby Yan Skyler Seto N. Apostoloff FaML 88 11 0 03 Feb 2022
Datamodels: Predicting Predictions from Training Data Andrew Ilyas Sung Min Park Logan Engstrom Guillaume Leclerc Aleksander Madry TDI 135 143 0 01 Feb 2022
TrustAL: Trustworthy Active Learning using Knowledge Distillation Beong-woo Kwak Youngwook Kim Yu Jin Kim Seung-won Hwang Jinyoung Yeo 41 7 0 26 Jan 2022
On Sampling Collaborative Filtering Datasets Noveen Sachdeva Carole-Jean Wu Julian McAuley 78 16 0 13 Jan 2022
Memory-Guided Semantic Learning Network for Temporal Sentence Grounding Daizong Liu Xiaoye Qu Xing Di Yu Cheng Zichuan Xu Pan Zhou 107 60 0 03 Jan 2022
Continual Learning for Unsupervised Anomaly Detection in Continuous Auditing of Financial Accounting Data Hamed Hemati Marco Schreyer Damian Borth 67 10 0 25 Dec 2021
On the Impact of Hard Adversarial Instances on Overfitting in Adversarial Training Chen Liu Zhichao Huang Mathieu Salzmann Tong Zhang Sabine Süsstrunk AAML 89 13 0 14 Dec 2021