Title
GraSS: Scalable Influence Function with Sparse Gradient Compression Pingbang Hu Joseph Melkonian Weijing Tang Han Zhao Jiaqi W. Ma TDI 250 0 0 25 May 2025
LEAD: Iterative Data Selection for Efficient LLM Instruction Tuning Xiaotian Lin Yanlin Qi Yizhang Zhu Themis Palpanas Chengliang Chai Nan Tang Yuyu Luo 72 1 0 12 May 2025
ALinFiK: Learning to Approximate Linearized Future Influence Kernel for Scalable Third-Party LLM Data Valuation Yanzhou Pan Huawei Lin Yide Ran Jiamin Chen Xiaodong Yu Weijie Zhao Denghui Zhang Zhaozhuo Xu 95 1 0 02 Mar 2025
QLESS: A Quantized Approach for Data Valuation and Selection in Large Language Model Fine-Tuning Moses Ananta Muhammad Farid Adilazuarda Zayd Muhammad Kawakibi Zuhri Ayu Purwarianti Alham Fikri Aji MQ 123 0 0 03 Feb 2025
How Much Can We Forget about Data Contamination? Sebastian Bordt Suraj Srinivas Valentyn Boreiko U. V. Luxburg 106 2 0 04 Oct 2024
Fast Training Dataset Attribution via In-Context Learning Milad Fotouhi M. T. Bahadori Oluwaseyi Feyisetan P. Arabshahi David Heckerman 84 0 0 14 Aug 2024
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research Luca Soldaini Rodney Michael Kinney Akshita Bhagia Dustin Schwenk David Atkinson ... Hanna Hajishirzi Iz Beltagy Dirk Groeneveld Jesse Dodge Kyle Lo 88 276 0 31 Jan 2024
DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models Yongchan Kwon Eric Wu K. Wu James Zou DiffM TDI 83 68 0 02 Oct 2023
Citation: A Key to Building Responsible and Accountable Large Language Models Jie Huang Kevin Chen-Chuan Chang HILM 76 19 0 05 Jul 2023
Addressing Budget Allocation and Revenue Allocation in Data Market Environments Using an Adaptive Sampling Algorithm Boxin Zhao Boxiang Lyu Raul Castro Fernandez Mladen Kolar 58 7 0 05 Jun 2023
If Influence Functions are the Answer, Then What is the Question? Juhan Bae Nathan Ng Alston Lo Marzyeh Ghassemi Roger C. Grosse TDI 92 103 0 12 Sep 2022
First is Better Than Last for Language Data Influence Chih-Kuan Yeh Ankur Taly Mukund Sundararajan Frederick Liu Pradeep Ravikumar TDI 77 22 0 24 Feb 2022
Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning Yongchan Kwon James Zou TDI 79 132 0 26 Oct 2021
Influence Selection for Active Learning Zhuoming Liu Hao Ding Huaping Zhong Weijia Li Jifeng Dai Conghui He TDI 67 95 0 20 Aug 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 450 2,096 0 31 Dec 2020
FastIF: Scalable Influence Functions for Efficient Model Interpretation and Debugging Han Guo Nazneen Rajani Peter Hase Joey Tianyi Zhou Caiming Xiong TDI 108 114 0 31 Dec 2020
Captum: A unified and generic model interpretability library for PyTorch Narine Kokhlikyan Vivek Miglani Miguel Martin Edward Wang B. Alsallakh ... Alexander Melnikov Natalia Kliushkina Carlos Araya Siqi Yan Orion Reblitz-Richardson FAtt 133 843 0 16 Sep 2020
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 187 464 0 09 Aug 2020
Influence Functions in Deep Learning Are Fragile S. Basu Phillip E. Pope Soheil Feizi TDI 125 235 0 25 Jun 2020
Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functions Xiaochuang Han Byron C. Wallace Yulia Tsvetkov MILM FAtt AAML TDI 77 174 0 14 May 2020
Estimating Training Data Influence by Tracing Gradient Descent G. Pruthi Frederick Liu Mukund Sundararajan Satyen Kale TDI 90 410 0 19 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 605 4,822 0 23 Jan 2020
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 439 20,181 0 23 Oct 2019
Data Valuation using Reinforcement Learning Jinsung Yoon Sercan O. Arik Tomas Pfister TDI 83 180 0 25 Sep 2019
Adversarial Examples Are Not Bugs, They Are Features Andrew Ilyas Shibani Santurkar Dimitris Tsipras Logan Engstrom Brandon Tran Aleksander Madry SILM 91 1,838 0 06 May 2019
TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning W. Wen Cong Xu Feng Yan Chunpeng Wu Yandan Wang Yiran Chen Hai Helen Li 140 989 0 22 May 2017
Understanding Black-box Predictions via Influence Functions Pang Wei Koh Percy Liang TDI 213 2,894 0 14 Mar 2017
Billion-scale similarity search with GPUs Jeff Johnson Matthijs Douze Hervé Jégou 257 3,723 0 28 Feb 2017
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 328 2,876 0 26 Sep 2016