v1v2v3 (latest)

An Empirical Study of Example Forgetting during Deep Neural Network Learning

12 December 2018

Mariya Toneva

Alessandro Sordoni

Rémi Tachet des Combes

Papers citing "An Empirical Study of Example Forgetting during Deep Neural Network Learning"

50 / 496 papers shown

Title
On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons Fangshuo Liao Anastasios Kyrillidis 106 16 0 05 Dec 2021
Hard Sample Aware Noise Robust Learning for Histopathology Image Classification Chuang Zhu Wenkai Chen T. Peng Ying Wang M. Jin NoLa 74 76 0 05 Dec 2021
Sample Prior Guided Robust Model Learning to Suppress Noisy Labels Wenkai Chen Chuang Zhu Yi Chen Mengting Li Tiejun Huang NoLa 62 12 0 02 Dec 2021
Accelerating Deep Learning with Dynamic Data Pruning Ravi Raju Kyle Daruwalla Mikko H. Lipasti 33 31 0 24 Nov 2021
DataCLUE: A Benchmark Suite for Data-centric NLP Liang Xu Jiacheng Liu X. Pan Xiaojing Lu Xiaofeng Hou ELM 48 16 0 16 Nov 2021
On the Importance of Difficulty Calibration in Membership Inference Attacks Lauren Watson Chuan Guo Graham Cormode Alex Sablayrolles 111 134 0 15 Nov 2021
MERCURY: Accelerating DNN Training By Exploiting Input Similarity Vahid Janfaza Kevin Weston Moein Razavi Shantanu Mandal Farabi Mahmud Alex Hilty A. Muzahid 63 5 0 28 Oct 2021
How Important is Importance Sampling for Deep Budgeted Training? Eric Arazo Diego Ortego Paul Albert Noel E. O'Connor Kevin McGuinness 114 8 0 27 Oct 2021
MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge Geng Yuan Xiaolong Ma Wei Niu Zhengang Li Zhenglun Kong ... Minghai Qin Bin Ren Yanzhi Wang Sijia Liu Xue Lin 91 96 0 26 Oct 2021
Addressing out-of-distribution label noise in webly-labelled data Paul Albert Diego Ortego Eric Arazo Noel E. O'Connor Kevin McGuinness NoLa 60 18 0 26 Oct 2021
Wide Neural Networks Forget Less Catastrophically Seyed Iman Mirzadeh Arslan Chaudhry Dong Yin Huiyi Hu Razvan Pascanu Dilan Görür Mehrdad Farajtabar CLL 86 68 0 21 Oct 2021
On Hard Episodes in Meta-Learning S. Basu Amr Sharaf Nicolò Fusi Soheil Feizi 54 1 0 21 Oct 2021
Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond) Kristof Meding Luca M. Schulze Buschoff Robert Geirhos Felix Wichmann 95 43 0 12 Oct 2021
Dataset Condensation with Distribution Matching Bo Zhao Hakan Bilen DD 82 308 0 08 Oct 2021
Data Summarization via Bilevel Optimization Zalan Borsos Mojmír Mutný Marco Tagliasacchi Andreas Krause 90 9 0 26 Sep 2021
Dynamic Knowledge Distillation for Pre-trained Language Models Lei Li Yankai Lin Shuhuai Ren Peng Li Jie Zhou Xu Sun 91 49 0 23 Sep 2021
The Grammar-Learning Trajectories of Neural Language Models Leshem Choshen Guy Hacohen D. Weinshall Omri Abend 113 29 0 13 Sep 2021
Face-NMS: A Core-set Selection Approach for Efficient Face Recognition Yunze Chen Junjie Huang Jiagang Zhu Zheng Zhu Tian Yang Guan Huang Dalong Du CVBM 28 1 0 10 Sep 2021
Learning Fast Sample Re-weighting Without Reward Data Zizhao Zhang Tomas Pfister 77 76 0 07 Sep 2021
T3-Vis: a visual analytic framework for Training and fine-Tuning Transformers in NLP Raymond Li Wen Xiao Lanjun Wang Hyeju Jang Giuseppe Carenini ViT 87 23 0 31 Aug 2021
Prototype-Guided Memory Replay for Continual Learning Stella Ho Ming Liu Lan Du Longxiang Gao Yong Xiang CLL 67 32 0 28 Aug 2021
MCML: A Novel Memory-based Contrastive Meta-Learning Method for Few Shot Slot Tagging Hongru Wang Zezhong Wang Gabriel Pui Cheong Fung Kam-Fai Wong OffRL CLL 89 10 0 26 Aug 2021
Unified Regularity Measures for Sample-wise Learning and Generalization Chi Zhang Xiaoning Ma Yu Liu Le Wang Yuanqi Su Yuehu Liu 65 1 0 09 Aug 2021
Grain: Improving Data Efficiency of Graph Neural Networks via Diversified Influence Maximization Wentao Zhang Zhi-Xin Yang Yexin Wang Yu Shen Yang Li Liang Wang Tengjiao Wang 88 50 0 31 Jul 2021
When Deep Learners Change Their Mind: Learning Dynamics for Active Learning Javad Zolfaghari Bengar Bogdan Raducanu Joost van de Weijer 51 10 0 30 Jul 2021
Deep Learning on a Data Diet: Finding Important Examples Early in Training Mansheej Paul Surya Ganguli Gintare Karolina Dziugaite 127 464 0 15 Jul 2021
Continual Learning in the Teacher-Student Setup: Impact of Task Similarity Sebastian Lee Sebastian Goldt Andrew M. Saxe CLL 83 74 0 09 Jul 2021
SSSE: Efficiently Erasing Samples from Trained Machine Learning Models Alexandra Peste Dan Alistarh Christoph H. Lampert MU 47 32 0 08 Jul 2021
Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering Siddharth Karamcheti Ranjay Krishna Li Fei-Fei Christopher D. Manning 96 92 0 06 Jul 2021
The Evolution of Out-of-Distribution Robustness Throughout Fine-Tuning Anders Andreassen Yasaman Bahri Behnam Neyshabur Rebecca Roelofs OOD OODD 104 82 0 30 Jun 2021
HODA: Hardness-Oriented Detection of Model Extraction Attacks A. M. Sadeghzadeh Amir Mohammad Sobhanian F. Dehghan R. Jalili MIACV 71 7 0 21 Jun 2021
Deep Learning Through the Lens of Example Difficulty R. Baldock Hartmut Maennel Behnam Neyshabur 89 161 0 17 Jun 2021
An Analytical Theory of Curriculum Learning in Teacher-Student Networks Luca Saglietti Stefano Sarao Mannelli Andrew M. Saxe 55 26 0 15 Jun 2021
Gradual Domain Adaptation in the Wild:When Intermediate Distributions are Absent Samira Abnar Rianne van den Berg Golnaz Ghiasi Mostafa Dehghani Nal Kalchbrenner Hanie Sedghi OOD CLL TTA 68 21 0 10 Jun 2021
Accelerating Neural Architecture Search via Proxy Data Byunggook Na J. Mok Hyeokjun Choe Sungroh Yoon 85 19 0 09 Jun 2021
Efficient Lottery Ticket Finding: Less Data is More Zhenyu Zhang Xuxi Chen Tianlong Chen Zhangyang Wang 111 54 0 06 Jun 2021
FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning S. K. Shyn Donghee Kim Kwangsu Kim FedML 79 23 0 04 Jun 2021
Case-based Reasoning for Natural Language Queries over Knowledge Bases Rajarshi Das Manzil Zaheer Dung Ngoc Thai Ameya Godbole Ethan Perez Jay Yoon Lee Lizhen Tan L. Polymenakos Andrew McCallum 111 169 0 18 Apr 2021
Learning from Noisy Labels for Entity-Centric Information Extraction Wenxuan Zhou Muhao Chen NoLa 66 65 0 17 Apr 2021
Memorisation versus Generalisation in Pre-trained Language Models Michael Tänzer Sebastian Ruder Marek Rei 112 51 0 16 Apr 2021
Distilled Replay: Overcoming Forgetting through Synthetic Samples Andrea Rosasco Antonio Carta Andrea Cossu Vincenzo Lomonaco D. Bacciu DD 73 49 0 29 Mar 2021
Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyond Xuhong Li Haoyi Xiong Xingjian Li Xuanyu Wu Xiao Zhang Ji Liu Jiang Bian Dejing Dou AAML FaML XAI HAI 82 341 0 19 Mar 2021
Continual Learning for Recurrent Neural Networks: an Empirical Evaluation Andrea Cossu Antonio Carta Vincenzo Lomonaco D. Bacciu CLL 93 110 0 12 Mar 2021
LongReMix: Robust Learning with High Confidence Samples in a Noisy Label Environment F. Cordeiro Ragav Sachdeva Vasileios Belagiannis Ian Reid G. Carneiro NoLa 74 80 0 06 Mar 2021
Extending Contrastive Learning to Unsupervised Coreset Selection Jeongwoo Ju Heechul Jung Yoonju Oh Junmo Kim SSL 34 12 0 05 Mar 2021
GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Training Krishnateja Killamsetty D. Sivasubramanian Ganesh Ramakrishnan A. De Rishabh K. Iyer OOD 159 207 0 27 Feb 2021
Multiplicative Reweighting for Robust Neural Network Optimization Noga Bar Tomer Koren Raja Giryes OOD NoLa 81 9 0 24 Feb 2021
Dataset Condensation with Differentiable Siamese Augmentation Bo Zhao Hakan Bilen DD 268 304 0 16 Feb 2021
Data Quality Matters For Adversarial Training: An Empirical Study Chengyu Dong Liyuan Liu Jingbo Shang AAML 56 10 0 15 Feb 2021
Unassisted Noise Reduction of Chemical Reaction Data Sets A. Toniato P. Schwaller Antonio Cardinale Joppe Geluykens Teodoro Laino AAML 55 24 0 02 Feb 2021