FastIF: Scalable Influence Functions for Efficient Model Interpretation and Debugging

31 December 2020

Papers citing "FastIF: Scalable Influence Functions for Efficient Model Interpretation and Debugging"

50 / 81 papers shown

Title
Scalable Multi-Stage Influence Function for Large Language Models via Eigenvalue-Corrected Kronecker-Factored Parameterization Yuntai Bao Xuhong Zhang Tianyu Du Xinkui Zhao Jiang Zong Hao Peng Jianwei Yin TDI 48 0 0 08 May 2025
ALinFiK: Learning to Approximate Linearized Future Influence Kernel for Scalable Third-Party LLM Data Valuation Yanzhou Pan Huawei Lin Yide Ran Jiamin Chen Xiaodong Yu Weijie Zhao Denghui Zhang Zhaozhuo Xu 40 0 0 02 Mar 2025
Data Attribution for Text-to-Image Models by Unlearning Synthesized Images Sheng-Yu Wang Aaron Hertzmann Alexei A. Efros Jun-Yan Zhu Richard Zhang TDI 128 2 0 21 Feb 2025
Mechanistic Unveiling of Transformer Circuits: Self-Influence as a Key to Model Reasoning L. Zhang Lijie Hu Di Wang LRM 92 0 0 17 Feb 2025
Building Bridges, Not Walls -- Advancing Interpretability by Unifying Feature, Data, and Model Component Attribution Shichang Zhang Tessa Han Usha Bhalla Hima Lakkaraju FAtt 147 0 0 17 Feb 2025
Dynamic Influence Tracker: Measuring Time-Varying Sample Influence During Training Jie Xu Zihan Wu TDI 53 0 0 15 Feb 2025
Addressing Delayed Feedback in Conversion Rate Prediction via Influence Functions Chenlu Ding Jiancan Wu Yancheng Yuan Junfeng Fang Cunchun Li Xiang Wang Xiangnan He 69 1 0 01 Feb 2025
Most Influential Subset Selection: Challenges, Promises, and Beyond Yuzheng Hu Pingbang Hu Han Zhao Jiaqi W. Ma TDI 142 2 0 10 Jan 2025
LossVal: Efficient Data Valuation for Neural Networks Tim Wibiral Mohamed Karim Belaid Maximilian Rabus Ansgar Scherp TDI 92 0 0 05 Dec 2024
A Versatile Influence Function for Data Attribution with Non-Decomposable Loss Junwei Deng Weijing Tang Jiaqi W. Ma TDI 129 0 0 02 Dec 2024
Data Quality Control in Federated Instruction-tuning of Large Language Models Yaxin Du Rui Ye Fengting Yuchi W. Zhao Jingjing Qu Y. Wang Siheng Chen ALM FedML 45 0 0 15 Oct 2024
HyperINF: Unleashing the HyperPower of the Schulz's Method for Data Influence Estimation Xinyu Zhou Simin Fan Martin Jaggi TDI 26 0 0 07 Oct 2024
Do Influence Functions Work on Large Language Models? Zhe Li Wei Zhao Yige Li Jun Sun TDI 28 1 0 30 Sep 2024
In2Core: Leveraging Influence Functions for Coreset Selection in Instruction Finetuning of Large Language Models Ayrton San Joaquin Bin Wang Zhengyuan Liu Nicholas Asher Brian Lim Philippe Muller Nancy Chen 34 0 0 07 Aug 2024
Data Debugging is NP-hard for Classifiers Trained with SGD Zizheng Guo Pengyu Chen Yanzhang Fu Xuelong Li 28 0 0 02 Aug 2024
Data-Centric AI in the Age of Large Language Models Xinyi Xu Zhaoxuan Wu Rui Qiao Arun Verma Yao Shu ... Xiaoqiang Lin Wenyang Hu Zhongxiang Dai Pang Wei Koh Bryan Kian Hsiang Low ALM 44 2 0 20 Jun 2024
WeShap: Weak Supervision Source Evaluation with Shapley Values Naiqing Guan Nick Koudas 52 0 0 16 Jun 2024
Helpful or Harmful Data? Fine-tuning-free Shapley Attribution for Explaining Language Model Predictions Jingtan Wang Xiaoqiang Lin Rui Qiao Chuan-Sheng Foo Bryan Kian Hsiang Low TDI 35 3 0 07 Jun 2024
How Video Meetings Change Your Expression Sumit Sarin Utkarsh Mall Purva Tendulkar Carl Vondrick CVBM 32 0 0 03 Jun 2024
Efficient Ensembles Improve Training Data Attribution Junwei Deng Ting-Wei Li Shichang Zhang Jiaqi Ma TDI 30 2 0 27 May 2024
Editable Concept Bottleneck Models Lijie Hu Chenyang Ren Zhengyu Hu Cheng-Long Wang Di Wang Hui Xiong Jingfeng Zhang Di Wang 32 3 0 24 May 2024
Which Experiences Are Influential for RL Agents? Efficiently Estimating The Influence of Experiences Takuya Hiraoka Guanquan Wang Takashi Onishi Yoshimasa Tsuruoka 37 0 0 23 May 2024
What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functions Sang Keun Choe Hwijeen Ahn Juhan Bae Kewen Zhao Minsoo Kang ... Teruko Mitamura Jeff Schneider Eduard Hovy Roger C. Grosse Eric P. Xing TDI 39 28 0 22 May 2024
The Echoes of Multilinguality: Tracing Cultural Value Shifts during LM Fine-tuning Rochelle Choenni Anne Lauscher Ekaterina Shutova 26 7 0 21 May 2024
Token-wise Influential Training Data Retrieval for Large Language Models Huawei Lin Jikai Long Zhaozhuo Xu Weijie Zhao 49 3 0 20 May 2024
Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System Chen Chen Ruizhe Li Yuchen Hu Yuanyuan Chen Chengwei Qin Qiang Zhang CLL 41 1 0 16 May 2024
Distilled Datamodel with Reverse Gradient Matching Jingwen Ye Ruonan Yu Songhua Liu Xinchao Wang DD 41 3 0 22 Apr 2024
Evolving Interpretable Visual Classifiers with Large Language Models Mia Chiquier Utkarsh Mall Carl Vondrick VLM 28 10 0 15 Apr 2024
InfFeed: Influence Functions as a Feedback to Improve the Performance of Subjective Tasks Somnath Banerjee Maulindu Sarkar Punyajoy Saha Binny Mathew Animesh Mukherjee TDI 34 0 0 22 Feb 2024
A Curious Case of Searching for the Correlation between Training Data and Adversarial Robustness of Transformer Textual Models Cuong Dang Dung D. Le Thai Le AAML 29 2 0 18 Feb 2024
Unlearning Traces the Influential Training Data of Language Models Masaru Isonuma Ivan Titov MU 24 6 0 26 Jan 2024
Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective Haoyi Xiong Xuhong Li Xiaofei Zhang Jiamin Chen Xinhao Sun Yuchen Li Zeyi Sun Mengnan Du XAI 37 8 0 09 Jan 2024
Deeper Understanding of Black-box Predictions via Generalized Influence Functions Hyeonsu Lyu Jonggyu Jang Sehyun Ryu H. Yang TDI AI4CE 18 5 0 09 Dec 2023
Examining Modularity in Multilingual LMs via Language-Specialized Subnetworks Rochelle Choenni Ekaterina Shutova Daniel H Garrette 27 8 0 14 Nov 2023
Reviewing Developments of Graph Convolutional Network Techniques for Recommendation Systems Haojun Zhu Vikram Kapoor Priya Sharma GNN 19 0 0 10 Nov 2023
SoK: Memorisation in machine learning Dmitrii Usynin Moritz Knolle Georgios Kaissis 17 1 0 06 Nov 2023
Exploring Practitioner Perspectives On Training Data Attribution Explanations Elisa Nguyen Evgenii Kortukov Jean Y. Song Seong Joon Oh TDI 379 1 0 31 Oct 2023
Sample based Explanations via Generalized Representers Che-Ping Tsai Chih-Kuan Yeh Pradeep Ravikumar FAtt 39 8 0 27 Oct 2023
Selectivity Drives Productivity: Efficient Dataset Pruning for Enhanced Transfer Learning Yihua Zhang Yimeng Zhang Aochuan Chen Jinghan Jia Jiancheng Liu Gaowen Liu Min-Fong Hong Shiyu Chang Sijia Liu AAML 29 8 0 13 Oct 2023
DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models Yongchan Kwon Eric Wu K. Wu James Zou DiffM TDI 18 53 0 02 Oct 2023
What Learned Representations and Influence Functions Can Tell Us About Adversarial Examples Shakila Mahjabin Tonni Mark Dras TDI AAML GAN 11 0 0 19 Sep 2023
Explainability for Large Language Models: A Survey Haiyan Zhao Hanjie Chen Fan Yang Ninghao Liu Huiqi Deng Hengyi Cai Shuaiqiang Wang Dawei Yin Mengnan Du LRM 23 408 0 02 Sep 2023
Evaluating Data Attribution for Text-to-Image Models Sheng-Yu Wang Alexei A. Efros Jun-Yan Zhu Richard Y. Zhang TDI 26 30 0 15 Jun 2023
Representer Point Selection for Explaining Regularized High-dimensional Models Che-Ping Tsai Jiong Zhang Eli Chien Hsiang-Fu Yu Cho-Jui Hsieh Pradeep Ravikumar 18 2 0 31 May 2023
A Bayesian Approach To Analysing Training Data Attribution In Deep Learning Elisa Nguyen Minjoon Seo Seong Joon Oh BDL 436 7 0 31 May 2023
Theoretical and Practical Perspectives on what Influence Functions Do Andrea Schioppa Katja Filippova Ivan Titov Polina Zablotskaia TDI 19 14 0 26 May 2023
How do languages influence each other? Studying cross-lingual data sharing during LM fine-tuning Rochelle Choenni Dan Garrette Ekaterina Shutova 32 15 0 22 May 2023
DataComp: In search of the next generation of multimodal datasets S. Gadre Gabriel Ilharco Alex Fang J. Hayase Georgios Smyrnis ... A. Dimakis J. Jitsev Y. Carmon Vaishaal Shankar Ludwig Schmidt VLM 27 408 0 27 Apr 2023
Regularizing Second-Order Influences for Continual Learning Zhicheng Sun Yadong Mu G. Hua CLL 9 22 0 20 Apr 2023
Revisiting the Fragility of Influence Functions Jacob R. Epifano Ravichandran Ramachandran A. Masino Ghulam Rasool TDI 8 14 0 22 Mar 2023