v1v2v3 (latest)

An Empirical Study of Example Forgetting during Deep Neural Network Learning

12 December 2018

Mariya Toneva

Alessandro Sordoni

Rémi Tachet des Combes

Papers citing "An Empirical Study of Example Forgetting during Deep Neural Network Learning"

50 / 496 papers shown

Title
On The Impact of Machine Learning Randomness on Group Fairness Prakhar Ganesh Hong Chang Martin Strobel Reza Shokri FaML 65 31 0 09 Jul 2023
Tools for Verifying Neural Models' Training Data Dami Choi Yonadav Shavit David Duvenaud MIALM 76 17 0 02 Jul 2023
Learning Unseen Modality Interaction Yunhua Zhang Hazel Doughty Cees G. M. Snoek 133 6 0 22 Jun 2023
MILD: Modeling the Instance Learning Dynamics for Learning with Noisy Labels Chuanyan Hu Shipeng Yan Zhitong Gao Xuming He NoLa 82 5 0 20 Jun 2023
Large-scale Dataset Pruning with Dynamic Uncertainty Muyang He Shuo Yang Tiejun Huang Bo Zhao 77 32 0 08 Jun 2023
A Dataset for Deep Learning-based Bone Structure Analyses in Total Hip Arthroplasty Kaiwen Zhang Ziyang Gan Dong Liu X. Shang 41 0 0 07 Jun 2023
NLU on Data Diets: Dynamic Data Subset Selection for NLP Classification Tasks Jean-Michel Attendu Jean-Philippe Corbeil 78 16 0 05 Jun 2023
Retrieval-Enhanced Visual Prompt Learning for Few-shot Classification Jintao Rong Hao Chen Tianrun Chen Linlin Ou Xinyi Yu Yifan Liu VLM VPVLM 71 6 0 04 Jun 2023
Calibrating Multimodal Learning Huanrong Zhang Changqing Zhang Bing Wu Huazhu Fu Qiufeng Wang Q. Hu 100 21 0 02 Jun 2023
Towards Sustainable Learning: Coresets for Data-efficient Deep Learning Yu Yang Hao Kang Baharan Mirzasoleiman 86 35 0 02 Jun 2023
Too Large; Data Reduction for Vision-Language Pre-Training Alex Jinpeng Wang Kevin Qinghong Lin David Junhao Zhang Stan Weixian Lei Mike Zheng Shou VLM 67 24 0 31 May 2023
infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-information Jaehyung Kim Yekyung Kim Karin de Langis Jinwoo Shin Dongyeop Kang 52 1 0 30 May 2023
Towards Efficient Deep Hashing Retrieval: Condensing Your Data via Feature-Embedding Matching Tao Feng Jie Zhang Peizheng Wang Zhijie Wang Shengyuan Pang DD 134 0 0 29 May 2023
Repeated Random Sampling for Minimizing the Time-to-Accuracy of Learning Patrik Okanovic R. Waleffe Vasilis Mageirakos Konstantinos E. Nikolakakis Amin Karbasi Dionysis Kalogerias Nezihe Merve Gürel Theodoros Rekatsinas DD 104 14 0 28 May 2023
Distill Gold from Massive Ores: Efficient Dataset Distillation via Critical Samples Selection Yue Xu Yong-Lu Li Kaitong Cui Ziyu Wang Cewu Lu Yu-Wing Tai Chi-Keung Tang DD 112 8 0 28 May 2023
Exploring Weight Balancing on Long-Tailed Recognition Problem Naoya Hasegawa Issei Sato 125 7 0 26 May 2023
SELFOOD: Self-Supervised Out-Of-Distribution Detection via Learning to Rank Dheeraj Mekala Adithya Samavedhi Chengyu Dong Jingbo Shang OODD 52 2 0 24 May 2023
Parameter-Efficient Language Model Tuning with Active Learning in Low-Resource Settings Josip Jukić Jan vSnajder 84 4 0 23 May 2023
Mitigating Label Noise through Data Ambiguation Julian Lienen Eyke Hüllermeier NoLa 64 7 0 23 May 2023
Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model Xiao Wang Wei Zhou Qi Zhang Jie Zhou Songyang Gao Junzhe Wang Menghan Zhang Xiang Gao Yunwen Chen Tao Gui 129 10 0 22 May 2023
CQural: A Novel CNN based Hybrid Architecture for Quantum Continual Machine Learning Sanyam Jain CLL 61 1 0 16 May 2023
Online Continual Learning Without the Storage Constraint Ameya Prabhu Zhipeng Cai P. Dokania Philip Torr V. Koltun Ozan Sener CLL 168 32 0 16 May 2023
PreCog: Exploring the Relation between Memorization and Performance in Pre-trained Language Models Leonardo Ranaldi Elena Sofia Ruzzetti Fabio Massimo Zanzotto 69 6 0 08 May 2023
Maintaining Stability and Plasticity for Predictive Churn Reduction George Adam B. Haibe-Kains Anna Goldenberg 52 1 0 06 May 2023
DataComp: In search of the next generation of multimodal datasets S. Gadre Gabriel Ilharco Alex Fang J. Hayase Georgios Smyrnis ... A. Dimakis J. Jitsev Y. Carmon Vaishaal Shankar Ludwig Schmidt VLM 104 452 0 27 Apr 2023
Learning Sample Difficulty from Pre-trained Models for Reliable Prediction Peng Cui Dan Zhang Zhijie Deng Yinpeng Dong Junyi Zhu 46 12 0 20 Apr 2023
Reweighted Mixup for Subpopulation Shift Zongbo Han Zhipeng Liang Fan Yang Liu Liu Lanqing Li ... P. Zhao Qinghua Hu Bing Wu Changqing Zhang Jianhua Yao 53 3 0 09 Apr 2023
Fairness-Aware Data Valuation for Supervised Learning José P. Pombal Pedro Saleiro Mário A. T. Figueiredo P. Bizarro TDI 71 4 0 29 Mar 2023
Lazy learning: a biologically-inspired plasticity rule for fast and energy efficient synaptic plasticity Aaron Pache M. V. Rossum 85 2 0 26 Mar 2023
A Bag-of-Prototypes Representation for Dataset-Level Applications Wei-Chih Tu Weijian Deng Tom Gedeon Liang Zheng 89 11 0 23 Mar 2023
Bayesian Pseudo-Coresets via Contrastive Divergence Piyush Tiwary Kumar Shubham V. Kashyap Prathosh A.P. 84 4 0 20 Mar 2023
Computationally Budgeted Continual Learning: What Does Matter? Ameya Prabhu Hasan Hammoud P. Dokania Philip Torr Ser-Nam Lim Guohao Li Adel Bibi CLL 78 63 0 20 Mar 2023
SemDeDup: Data-efficient learning at web-scale through semantic deduplication Amro Abbas Kushal Tirumala Daniel Simig Surya Ganguli Ari S. Morcos 77 182 0 16 Mar 2023
Active Semi-Supervised Learning by Exploring Per-Sample Uncertainty and Consistency Jae-Kwang Lim Jongkeun Na Nojun Kwak 73 2 0 15 Mar 2023
Towards High-Quality and Efficient Video Super-Resolution via Spatial-Temporal Data Overfitting Gen Li Jie Ji Minghai Qin Wei Niu Bin Ren Fatemeh Afghah Lin Guo Xiaolong Ma SupR 121 11 0 15 Mar 2023
Eliciting Latent Predictions from Transformers with the Tuned Lens Nora Belrose Zach Furman Logan Smith Danny Halawi Igor V. Ostrovsky Lev McKinney Stella Biderman Jacob Steinhardt 109 231 0 14 Mar 2023
InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning Ziheng Qin Kaidi Wang Zangwei Zheng Jianyang Gu Xiang Peng ... Daquan Zhou Lei Shang Baigui Sun Xuansong Xie Yang You 187 53 0 08 Mar 2023
Loss-Curvature Matching for Dataset Selection and Condensation Seung-Jae Shin Heesun Bae DongHyeok Shin Weonyoung Joo Il-Chul Moon DD 94 27 0 08 Mar 2023
A Challenging Benchmark for Low-Resource Learning Yudong Wang Chang Ma Qingxiu Dong Lingpeng Kong Jingjing Xu 70 4 0 07 Mar 2023
When does Privileged Information Explain Away Label Noise? Guillermo Ortiz-Jiménez Mark Collier Anant Nawalgaria Alexander DÁmour Jesse Berent Rodolphe Jenatton E. Kokiopoulou NoLa 204 7 0 03 Mar 2023
DREAM: Efficient Dataset Distillation by Representative Matching Yanqing Liu Jianyang Gu Kai Wang Zheng Hua Zhu Wei Jiang Yang You DD 125 80 0 28 Feb 2023
Make Every Example Count: On the Stability and Utility of Self-Influence for Learning from Noisy NLP Datasets Irina Bejan Artem Sokolov Katja Filippova TDI 130 11 0 27 Feb 2023
Finding Support Examples for In-Context Learning Xiaonan Li Xipeng Qiu 122 101 0 27 Feb 2023
Example Forgetting: A Novel Approach to Explain and Interpret Deep Neural Networks in Seismic Interpretation Ryan Benkert Oluwaseun Joseph Aribido Ghassan AlRegib 52 8 0 24 Feb 2023
Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective Baoyuan Wu Zihao Zhu Li Liu Qingshan Liu Zhaofeng He Siwei Lyu AAML 112 23 0 19 Feb 2023
Beyond Distribution Shift: Spurious Features Through the Lens of Training Dynamics Nihal Murali A. Puli Ke Yu Rajesh Ranganath Kayhan Batmanghelich AAML 77 10 0 18 Feb 2023
Data-Efficient Contrastive Self-supervised Learning: Most Beneficial Examples for Supervised Learning Contribute the Least S. Joshi Baharan Mirzasoleiman SSL 94 22 0 18 Feb 2023
Gaussian Switch Sampling: A Second Order Approach to Active Learning Ryan Benkert Mohit Prabhushankar Ghassan Al-Regib Armin Pacharmi E. Corona AAML 83 9 0 16 Feb 2023
Data pruning and neural scaling laws: fundamental limitations of score-based algorithms Fadhel Ayed Soufiane Hayou 77 10 0 14 Feb 2023
Unsupervised Deep One-Class Classification with Adaptive Threshold based on Training Dynamics Minkyung Kim Junsik Kim Jongmin Yu Jun Kyun Choi 75 2 0 13 Feb 2023