v1v2v3 (latest)

An Empirical Study of Example Forgetting during Deep Neural Network Learning

12 December 2018

Mariya Toneva

Alessandro Sordoni

Rémi Tachet des Combes

Papers citing "An Empirical Study of Example Forgetting during Deep Neural Network Learning"

46 / 496 papers shown

Title
Estimating informativeness of samples with Smooth Unique Information Hrayr Harutyunyan Alessandro Achille Giovanni Paolini Orchid Majumder Avinash Ravichandran Rahul Bhotika Stefano Soatto 89 25 0 17 Jan 2021
Robust Learning by Self-Transition for Handling Noisy Labels Hwanjun Song Minseok Kim Dongmin Park Yooju Shin Jae-Gil Lee NoLa 72 41 0 08 Dec 2020
When Do Curricula Work? Xiaoxia Wu Ethan Dyer Behnam Neyshabur 92 118 0 05 Dec 2020
Positive-Congruent Training: Towards Regression-Free Model Updates Sijie Yan Yuanjun Xiong Kaustav Kundu Shuo Yang Siqi Deng Meng Wang Wei Xia Stefano Soatto BDL 93 53 0 18 Nov 2020
Combining Ensembles and Data Augmentation can Harm your Calibration Yeming Wen Ghassen Jerfel Rafael Muller Michael W. Dusenberry Jasper Snoek Balaji Lakshminarayanan Dustin Tran UQCV 136 64 0 19 Oct 2020
Are all negatives created equal in contrastive instance discrimination? Tiffany Cai Jonathan Frankle D. Schwab Ari S. Morcos SSL 76 83 0 13 Oct 2020
Linear Mode Connectivity in Multitask and Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Dilan Görür Razvan Pascanu H. Ghasemzadeh CLL 86 147 0 09 Oct 2020
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix T. Doan Mehdi Abbana Bennani Bogdan Mazoure Guillaume Rabusseau Pierre Alquier CLL 88 86 0 07 Oct 2020
Efficient Meta Lifelong-Learning with Limited Memory Zirui Wang Sanket Vaibhav Mehta Barnabás Póczós J. Carbonell CLL KELM 78 76 0 06 Oct 2020
Binary Neural Networks for Memory-Efficient and Effective Visual Place Recognition in Changing Environments Bruno Ferrarini Michael Milford Klaus D. McDonald-Maier Shoaib Ehsan MQ 57 23 0 01 Oct 2020
Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics Swabha Swayamdipta Roy Schwartz Nicholas Lourie Yizhong Wang Hannaneh Hajishirzi Noah A. Smith Yejin Choi 147 452 0 22 Sep 2020
Meta-Learning with Sparse Experience Replay for Lifelong Language Learning Nithin Holla Pushkar Mishra H. Yannakoudakis Ekaterina Shutova KELM CLL 78 22 0 10 Sep 2020
An Empirical Analysis of Backward Compatibility in Machine Learning Systems Megha Srivastava Besmira Nushi Ece Kamar S. Shah Eric Horvitz AAML 94 47 0 11 Aug 2020
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 245 472 0 09 Aug 2020
Anatomy of Catastrophic Forgetting: Hidden Representations and Task Semantics V. Ramasesh Ethan Dyer M. Raghu CLL 107 179 0 14 Jul 2020
Improving Face Recognition by Clustering Unlabeled Faces in the Wild Aruni RoyChowdhury Xiang Yu Kihyuk Sohn Erik Learned-Miller Manmohan Chandraker CVBM 65 19 0 14 Jul 2020
Confidence-Aware Learning for Deep Neural Networks J. Moon Jihyo Kim Younghak Shin Sangheum Hwang UQCV 99 150 0 03 Jul 2020
Gradient-based Editing of Memory Examples for Online Task-free Continual Learning Xisen Jin Arka Sadhu Junyi Du Xiang Ren CLL KELM BDL 76 99 0 27 Jun 2020
Optimization and Generalization of Regularization-Based Continual Learning: a Loss Approximation Viewpoint Dong Yin Mehrdad Farajtabar Ang Li Nir Levine Alex Mott CLL 86 21 0 19 Jun 2020
Understanding the Role of Training Regimes in Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Razvan Pascanu H. Ghasemzadeh CLL 81 228 0 12 Jun 2020
Dataset Condensation with Gradient Matching Bo Zhao Konda Reddy Mopuri Hakan Bilen DD 138 503 0 10 Jun 2020
Assessing the Bilingual Knowledge Learned by Neural Machine Translation Models Shilin He Xing Wang Shuming Shi Michael R. Lyu Zhaopeng Tu 53 5 0 28 Apr 2020
The Right Tool for the Job: Matching Model and Instance Complexities Roy Schwartz Gabriel Stanovsky Swabha Swayamdipta Jesse Dodge Noah A. Smith 142 170 0 16 Apr 2020
Hyperplane Arrangements of Trained ConvNets Are Biased Matteo Gamba S. Carlsson Hossein Azizpour Mårten Björkman 41 5 0 17 Mar 2020
Reducing Geographic Performance Differential for Face Recognition Martins Bruveris Jochem Gietema Pouria Mortazavian Mohan Mahadevan CVBM 31 8 0 27 Feb 2020
Investigating the Compositional Structure Of Deep Neural Networks Francesco Craighero Fabrizio Angaroni Alex Graudenzi Fabio Stella M. Antoniotti FAtt 48 5 0 17 Feb 2020
Object Detection as a Positive-Unlabeled Problem Yuewei Yang Kevin J. Liang Lawrence Carin 72 39 0 11 Feb 2020
Characterizing Structural Regularities of Labeled Data in Overparameterized Models Ziheng Jiang Chiyuan Zhang Kunal Talwar Michael C. Mozer TDI 68 104 0 08 Feb 2020
Dissecting Catastrophic Forgetting in Continual Learning by Deep Visualization Giang Nguyen Shuan Chen T. Do Tae Joon Jun Ho-Jin Choi Daeyoung Kim 50 10 0 06 Jan 2020
Learning and Memorizing Representative Prototypes for 3D Point Cloud Semantic and Instance Segmentation Tong He Dong Gong Zhi Tian Chunhua Shen 3DV 103 39 0 06 Jan 2020
Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data F. Such Aditya Rawal Joel Lehman Kenneth O. Stanley Jeff Clune DD 72 157 0 17 Dec 2019
Empirical Study of Easy and Hard Examples in CNN Training Ikki Kishida Hideki Nakayama 50 13 0 25 Nov 2019
Increasing Robustness to Spurious Correlations using Forgettable Examples Yadollah Yaghoobzadeh Soroush Mehri Remi Tachet Timothy J. Hazen Alessandro Sordoni OOD 63 18 0 10 Nov 2019
Robust Training with Ensemble Consensus Jisoo Lee Sae-Young Chung NoLa 81 28 0 22 Oct 2019
Orthogonal Gradient Descent for Continual Learning Mehrdad Farajtabar Navid Azizan Alex Mott Ang Li CLL 120 376 0 15 Oct 2019
Automatic Construction of Multi-layer Perceptron Network from Streaming Examples Mahardhika Pratama Choiru Za’in Andri Ashfahani Yew-Soon Ong Weiping Ding AI4CE 130 52 0 08 Oct 2019
Data Valuation using Reinforcement Learning Jinsung Yoon Sercan O. Arik Tomas Pfister TDI 91 182 0 25 Sep 2019
Sampling Bias in Deep Active Classification: An Empirical Study Ameya Prabhu Charles Dognin M. Singh 78 64 0 20 Sep 2019
Selection via Proxy: Efficient Data Selection for Deep Learning Cody Coleman Christopher Yeh Stephen Mussmann Baharan Mirzasoleiman Peter Bailis Percy Liang J. Leskovec Matei A. Zaharia 116 350 0 26 Jun 2019
Episodic Memory in Lifelong Language Learning Cyprien de Masson dÁutume Sebastian Ruder Lingpeng Kong Dani Yogatama CLL KELM 141 292 0 03 Jun 2019
Training Data Subset Search with Ensemble Active Learning Kashyap Chitta J. Álvarez Elmar Haussmann C. Farabet 87 13 0 29 May 2019
Lifelong Neural Predictive Coding: Learning Cumulatively Online without Forgetting Alexander Ororbia A. Mali Daniel Kifer C. Lee Giles CLL KELM 80 16 0 25 May 2019
Meta-learners' learning dynamics are unlike learners' Neil C. Rabinowitz OffRL 88 16 0 03 May 2019
Active Domain Randomization Bhairav Mehta Manfred Diaz Florian Golemo C. Pal Liam Paull 84 265 0 09 Apr 2019
Topology-based Representative Datasets to Reduce Neural Network Training Resources Rocio Gonzalez-Diaz Miguel A. Gutiérrez-Naranjo Eduardo Paluzo-Hidalgo DD 56 9 0 20 Mar 2019
Seven Myths in Machine Learning Research Oscar Chang Hod Lipson 15 0 0 18 Feb 2019