ResearchTrend.AI
An Empirical Study of Example Forgetting during Deep Neural Network Learning
v1v2v3 (latest)

An Empirical Study of Example Forgetting during Deep Neural Network Learning

Mariya Toneva
Alessandro Sordoni
Rémi Tachet des Combes
Adam Trischler
Yoshua Bengio
Geoffrey J. Gordon
ArXiv (abs)PDFHTML

Papers citing "An Empirical Study of Example Forgetting during Deep Neural Network Learning"

50 / 496 papers shown
Title
Foundation Model Insights and a Multi-Model Approach for Superior Fine-Grained One-shot Subset Selection
Foundation Model Insights and a Multi-Model Approach for Superior Fine-Grained One-shot Subset Selection
Zhijing Wan
Zhixiang Wang
Zheng Wang
Xin Xu
Shiníchi Satoh
17
0
0
17 Jun 2025
When Forgetting Triggers Backdoors: A Clean Unlearning Attack
When Forgetting Triggers Backdoors: A Clean Unlearning Attack
Marco Arazzi
Antonino Nocera
Vinod Puthuvath
AAMLMUOnRL
24
0
0
14 Jun 2025
Effective Data Pruning through Score Extrapolation
Sebastian Schmidt
Prasanga Dhungel
Christoffer Löffler
Bjorn Nieth
Stephan Günnemann
Leo Schwinn
SyDa
24
0
0
10 Jun 2025
Info-Coevolution: An Efficient Framework for Data Model Coevolution
Ziheng Qin
Hailun Xu
Wei Chee Yew
Qi Jia
Yang Luo
Kanchan Sarkar
Danhui Guan
Kai Wang
Yang You
15
0
0
09 Jun 2025
On Support Samples of Next Word Prediction
On Support Samples of Next Word Prediction
Yuqian Li
Yupei Du
Yufang Liu
Feifei Feng
Mou Xiao Feng
Y. Wu
60
0
0
04 Jun 2025
GORACS: Group-level Optimal Transport-guided Coreset Selection for LLM-based Recommender Systems
GORACS: Group-level Optimal Transport-guided Coreset Selection for LLM-based Recommender Systems
Tiehua Mei
Hengrui Chen
Peng Yu
Jiaqing Liang
Deqing Yang
80
0
0
04 Jun 2025
Replay Can Provably Increase Forgetting
Yasaman Mahdaviyeh
James Lucas
Mengye Ren
A. Tolias
R. Zemel
T. Pitassi
KELMCLL
77
0
0
04 Jun 2025
EPiC: Towards Lossless Speedup for Reasoning Training through Edge-Preserving CoT Condensation
EPiC: Towards Lossless Speedup for Reasoning Training through Edge-Preserving CoT Condensation
Jinghan Jia
Hadi Reisizadeh
Chongyu Fan
Nathalie Baracaldo
Mingyi Hong
Sijia Liu
LRM
119
0
0
04 Jun 2025
Data Pruning by Information Maximization
Data Pruning by Information Maximization
Haoru Tan
Sitong Wu
Wei Huang
Shizhen Zhao
Xiaojuan Qi
49
1
0
02 Jun 2025
Data Heterogeneity Modeling for Trustworthy Machine Learning
Data Heterogeneity Modeling for Trustworthy Machine Learning
Jiashuo Liu
Peng Cui
47
0
0
01 Jun 2025
Progressive Data Dropout: An Embarrassingly Simple Approach to Faster Training
Progressive Data Dropout: An Embarrassingly Simple Approach to Faster Training
S. Srinivasan
Xinyue Hao
Shihao Hou
Yang Lu
Laura Sevilla-Lara
Anurag Arnab
Shreyank N Gowda
60
0
0
28 May 2025
A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advances
A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advances
Brian B. Moser
Arundhati S. Shanbhag
Stanislav Frolov
Federico Raue
Joachim Folz
Andreas Dengel
252
0
0
23 May 2025
Extending Dataset Pruning to Object Detection: A Variance-based Approach
Ryota Yagi
VLM
48
0
0
22 May 2025
DiffProb: Data Pruning for Face Recognition
DiffProb: Data Pruning for Face Recognition
Eduarda Caldeira
Jan Niklas Kolf
Naser Damer
Fadi Boutros
47
0
0
21 May 2025
Model Performance-Guided Evaluation Data Selection for Effective Prompt Optimization
Model Performance-Guided Evaluation Data Selection for Effective Prompt Optimization
Ximing Dong
Shaowei Wang
Dayi Lin
Ahmed E. Hassan
73
0
0
15 May 2025
When Dynamic Data Selection Meets Data Augmentation
When Dynamic Data Selection Meets Data Augmentation
Steve Yang
Peng Ye
Furao Shen
Dongzhan Zhou
78
0
0
02 May 2025
Handling Label Noise via Instance-Level Difficulty Modeling and Dynamic Optimization
Handling Label Noise via Instance-Level Difficulty Modeling and Dynamic Optimization
Kuan Zhang
Chengliang Chai
Jingzhe Xu
Chi Zhang
Ye Yuan
Guoren Wang
Lei Cao
NoLa
156
1
0
01 May 2025
Identifying Key Challenges of Hardness-Based Resampling
Identifying Key Challenges of Hardness-Based Resampling
Pawel Pukowski
Venet Osmani
70
0
0
09 Apr 2025
PEAKS: Selecting Key Training Examples Incrementally via Prediction Error Anchored by Kernel Similarity
PEAKS: Selecting Key Training Examples Incrementally via Prediction Error Anchored by Kernel Similarity
Mustafa Burak Gurbuz
Xingyu Zheng
C. Dovrolis
OOD
90
0
0
07 Apr 2025
Multivariate Temporal Regression at Scale: A Three-Pillar Framework Combining ML, XAI, and NLP
Multivariate Temporal Regression at Scale: A Three-Pillar Framework Combining ML, XAI, and NLP
Jiztom Kavalakkatt Francis
Matthew J. Darr
82
0
0
02 Apr 2025
Geometric Median Matching for Robust k-Subset Selection from Noisy Data
Geometric Median Matching for Robust k-Subset Selection from Noisy Data
Anish Acharya
Sujay Sanghavi
Alexandros G. Dimakis
Inderjit S Dhillon
AAML
176
0
0
01 Apr 2025
Pay More Attention to the Robustness of Prompt for Instruction Data Mining
Pay More Attention to the Robustness of Prompt for Instruction Data Mining
Qiang Wang
Dawei Feng
Xu Zhang
Ao Shen
Yang Xu
Bo Ding
H. Wang
AAML
85
0
0
31 Mar 2025
Severing Spurious Correlations with Data Pruning
Severing Spurious Correlations with Data Pruning
Varun Mulchandani
Jung-Eun Kim
468
1
0
24 Mar 2025
Revisiting Automatic Data Curation for Vision Foundation Models in Digital Pathology
Revisiting Automatic Data Curation for Vision Foundation Models in Digital Pathology
Boqi Chen
Cédric Vincent-Cuaz
Lydia A. Schoenpflug
Manuel Madeira
Lisa Fournier
...
D. Thanou
V. Koelzer
Pascal Frossard
Gabriele Campanella
Gunnar Rätsch
94
1
0
24 Mar 2025
Squeeze Out Tokens from Sample for Finer-Grained Data Governance
Squeeze Out Tokens from Sample for Finer-Grained Data Governance
Weixiong Lin
Chen Ju
Haicheng Wang
Shengchao Hu
Shuai Xiao
...
Yuheng Jiao
Mingshuai Yao
Jinsong Lan
Qingwen Liu
Ying Chen
84
0
0
18 Mar 2025
Scale Efficient Training for Large Datasets
Scale Efficient Training for Large Datasets
Qing Zhou
Junyu Gao
Qi Wang
DD
119
0
0
17 Mar 2025
A Large-Scale Study on Video Action Dataset Condensation
A Large-Scale Study on Video Action Dataset Condensation
Yang Chen
Sheng Guo
Bo Zheng
Limin Wang
DD
156
3
0
13 Mar 2025
Finding the Muses: Identifying Coresets through Loss Trajectories
M. Nagaraj
Deepak Ravikumar
Efstathia Soufleri
Kaushik Roy
83
0
0
12 Mar 2025
Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyond
Qiongxiu Li
Xiaoyu Luo
Yiyi Chen
Johannes Bjerva
230
2
0
10 Mar 2025
Data Efficient Subset Training with Differential Privacy
Ninad Jayesh Gandhi
Moparthy Venkata Subrahmanya Sri Harsha
100
0
0
09 Mar 2025
PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequence
PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequence
Yunxiao Shi
Wujiang Xu
Zeqi Zhang
Xing Zi
Qiang Wu
Min Xu
131
1
0
04 Mar 2025
Your Model is Overconfident, and Other Lies We Tell Ourselves
Timothee Mickus
Aman Sinha
Raúl Vázquez
76
0
0
03 Mar 2025
Confounder-Aware Medical Data Selection for Fine-Tuning Pretrained Vision Models
Anyang Ji
Qingbo Kang
Wei Xu
Changfan Wang
Kang Li
Qicheng Lao
69
0
0
02 Mar 2025
Training-Free Dataset Pruning for Instance Segmentation
Yalun Dai
Lingao Xiao
Ivor W. Tsang
Yang He
ISeg
99
2
0
02 Mar 2025
Fewer May Be Better: Enhancing Offline Reinforcement Learning with Reduced Dataset
Fewer May Be Better: Enhancing Offline Reinforcement Learning with Reduced Dataset
Yiqin Yang
Quanwei Wang
Chenghao Li
Hao Hu
Chengjie Wu
...
Dianyu Zhong
Ziyou Zhang
Qianchuan Zhao
Chongjie Zhang
Xu Bo
OffRL
112
0
0
26 Feb 2025
Coreset Selection via LLM-based Concept Bottlenecks
Coreset Selection via LLM-based Concept Bottlenecks
Akshay Mehra
Trisha Mittal
Subhadra Gopalakrishnan
Joshua Kimball
86
0
0
23 Feb 2025
Does Training with Synthetic Data Truly Protect Privacy?
Does Training with Synthetic Data Truly Protect Privacy?
Yunpeng Zhao
Jie Zhang
143
1
0
18 Feb 2025
Dynamic Influence Tracker: Measuring Time-Varying Sample Influence During Training
Dynamic Influence Tracker: Measuring Time-Varying Sample Influence During Training
Jie Xu
Zihan Wu
TDI
101
0
0
15 Feb 2025
Early Stopping Against Label Noise Without Validation Data
Early Stopping Against Label Noise Without Validation Data
Suqin Yuan
Lei Feng
Tongliang Liu
NoLa
273
19
0
11 Feb 2025
On Learning Representations for Tabular Data Distillation
On Learning Representations for Tabular Data Distillation
Inwon Kang
Parikshit Ram
Yi Zhou
Horst Samulowitz
Oshani Seneviratne
DD
108
0
0
23 Jan 2025
Geometric Median (GM) Matching for Robust Data Pruning
Geometric Median (GM) Matching for Robust Data Pruning
Anish Acharya
Inderjit S Dhillon
Sujay Sanghavi
AAML
139
0
0
20 Jan 2025
Generative Dataset Distillation Based on Self-knowledge Distillation
Generative Dataset Distillation Based on Self-knowledge Distillation
Longzhen Li
Ge Li
Ren Togo
Keisuke Maeda
Takahiro Ogawa
Miki Haseyama
DD
123
1
0
08 Jan 2025
MM-GEN: Enhancing Task Performance Through Targeted Multimodal Data Curation
MM-GEN: Enhancing Task Performance Through Targeted Multimodal Data Curation
S. Joshi
Besmira Nushi
Vidhisha Balachandran
Varun Chandrasekaran
Vibhav Vineet
Neel Joshi
Baharan Mirzasoleiman
MLLMVLM
168
0
0
07 Jan 2025
Swift Cross-Dataset Pruning: Enhancing Fine-Tuning Efficiency in Natural Language Understanding
Swift Cross-Dataset Pruning: Enhancing Fine-Tuning Efficiency in Natural Language Understanding
Binh-Nguyen Nguyen
Yang He
108
1
0
05 Jan 2025
Differentiable Prompt Learning for Vision Language Models
Zhenhan Huang
Tejaswini Pedapati
Pin-Yu Chen
Jianxi Gao
VLM
85
0
0
03 Jan 2025
Uncovering Memorization Effect in the Presence of Spurious Correlations
Uncovering Memorization Effect in the Presence of Spurious Correlations
Chenyu You
Haocheng Dai
Yifei Min
Jasjeet Sekhon
S. Joshi
James S. Duncan
157
3
0
01 Jan 2025
Demystifying CLIP Data
Demystifying CLIP Data
Hu Xu
Saining Xie
Xiaoqing Ellen Tan
Po-Yao (Bernie) Huang
Russell Howes
Vasu Sharma
Shang-Wen Li
Gargi Ghosh
Luke Zettlemoyer
Christoph Feichtenhofer
VLMCLIP
136
127
0
31 Dec 2024
Audiopedia: Audio QA with Knowledge
Audiopedia: Audio QA with Knowledge
Abhirama Subramanyam Penamakuri
Kiran Chhatre
Akshat Jain
KELMAuLLMRALM
164
0
0
31 Dec 2024
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models
Yulei Qin
Yuncheng Yang
Pengcheng Guo
Gang Li
Hang Shao
Yuchen Shi
Zihan Xu
Yun Gu
Ke Li
Xing Sun
ALM
201
13
0
31 Dec 2024
Adaptive Dataset Quantization
Adaptive Dataset Quantization
Muquan Li
Dongyang Zhang
Qiang Dong
Xiurui Xie
Ke Qin
DDMQ
124
0
0
22 Dec 2024

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.