What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation

9 August 2020

Papers citing "What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation"

50 / 193 papers shown

Title
Adversarial Attacks on Data Attribution Xinhe Wang Pingbang Hu Junwei Deng Jiaqi W. Ma TDI 63 0 0 09 Sep 2024
Recent Advances in Attack and Defense Approaches of Large Language Models Jing Cui Yishi Xu Zhewei Huang Shuchang Zhou Jianbin Jiao Junge Zhang PILM AAML 57 1 0 05 Sep 2024
EMP: Enhance Memory in Data Pruning Jinying Xiao Ping Li Jie Nie Zhe Tang VLM 57 0 0 28 Aug 2024
Protecting against simultaneous data poisoning attacks Neel Alex Shoaib Ahmed Siddiqui Amartya Sanyal David M. Krueger AAML 54 1 0 23 Aug 2024
LLM-PBE: Assessing Data Privacy in Large Language Models Qinbin Li Junyuan Hong Chulin Xie Jeffrey Tan Rachel Xin ... Dan Hendrycks Zhangyang Wang Bo Li Bingsheng He Dawn Song ELM PILM 42 13 0 23 Aug 2024
Not Every Image is Worth a Thousand Words: Quantifying Originality in Stable Diffusion Adi Haviv Shahar Sarfaty Uri Y. Hacohen N. Elkin-Koren Roi Livni Amit H. Bermano 37 2 0 15 Aug 2024
Towards flexible perception with visual memory Robert Geirhos P. Jaini Austin Stone Sourabh Medapati Xi Yi G. Toderici Abhijit Ogale Jonathon Shlens 42 1 0 15 Aug 2024
Fast Training Dataset Attribution via In-Context Learning Milad Fotouhi M. T. Bahadori Oluwaseyi Feyisetan P. Arabshahi David Heckerman 36 0 0 14 Aug 2024
Global-to-Local Support Spectrums for Language Model Explainability Lucas Agussurja Xinyang Lu Bryan Kian Hsiang Low FAtt 36 0 0 12 Aug 2024
Generalisation First, Memorisation Second? Memorisation Localisation for Natural Language Classification Tasks Verna Dankers Ivan Titov 45 5 0 09 Aug 2024
Range Membership Inference Attacks Jiashu Tao Reza Shokri 45 1 0 09 Aug 2024
2D-OOB: Attributing Data Contribution through Joint Valuation Framework Yifan Sun Jingyan Shen Yongchan Kwon TDI 43 1 0 07 Aug 2024
Demystifying Verbatim Memorization in Large Language Models Jing Huang Diyi Yang Christopher Potts ELM PILM MU 55 19 0 25 Jul 2024
TimeInf: Time Series Data Contribution via Influence Functions Yizi Zhang Jingyan Shen Xiaoxue Xiong Yongchan Kwon AI4TS TDI 34 0 0 21 Jul 2024
Enhancing High-Energy Particle Physics Collision Analysis through Graph Data Attribution Techniques A. Verdone A. Devoto C. Sebastiani J. Carmignani M. D’Onofrio S. Giagu S. Scardapane M. Panella 49 0 0 20 Jul 2024
Extracting Training Data from Document-Based VQA Models Francesco Pinto N. Rauschmayr F. Tramèr Philip Torr Federico Tombari 37 3 0 11 Jul 2024
Curvature Clues: Decoding Deep Learning Privacy with Input Loss Curvature Deepak Ravikumar Efstathia Soufleri Kaushik Roy 37 0 0 03 Jul 2024
A Method to Facilitate Membership Inference Attacks in Deep Learning Models Zitao Chen Karthik Pattabiraman MIACV MLAU AAML MIALM 75 1 0 02 Jul 2024
Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearning Nexhi Sula Abhinav Kumar Jie Hou Han Wang R. Tourani MU 25 0 0 01 Jul 2024
Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers Yibo Jiang Goutham Rajendran Pradeep Ravikumar Bryon Aragam CLL KELM 37 6 0 26 Jun 2024
LayerMatch: Do Pseudo-labels Benefit All Layers? Chaoqi Liang Guanglei Yang Lifeng Qiao Zitong Huang Hongliang Yan Yunchao Wei W. Zuo 49 0 0 20 Jun 2024
Evaluating $n$ -Gram Novelty of Language Models Using Rusty-DAWG William Merrill Noah A. Smith Yanai Elazar ELM TDI 50 9 0 18 Jun 2024
Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs Abhimanyu Hans Yuxin Wen Neel Jain John Kirchenbauer Hamid Kazemi ... Siddharth Singh Gowthami Somepalli Jonas Geiping A. Bhatele Tom Goldstein 36 32 0 14 Jun 2024
On the Minimal Degree Bias in Generalization on the Unseen for non-Boolean Functions Denys Pushkin Raphael Berthier Emmanuel Abbe 32 0 0 10 Jun 2024
Evolution-aware VAriance (EVA) Coreset Selection for Medical Image Classification Yuxin Hong Xiao Zhang Xin Zhang Joey Tianyi Zhou 45 2 0 09 Jun 2024
Causal Estimation of Memorisation Profiles Pietro Lesci Clara Meister Thomas Hofmann Andreas Vlachos Tiago Pimentel 51 5 0 06 Jun 2024
Memorization in deep learning: A survey Jiaheng Wei Yanjun Zhang Leo Yu Zhang Ming Ding Chao Chen Kok-Leong Ong Jun Zhang Yang Xiang 47 6 0 06 Jun 2024
BWS: Best Window Selection Based on Sample Scores for Data Pruning across Broad Ranges Hoyong Choi Nohyun Ki Hye Won Chung 29 2 0 05 Jun 2024
Measuring Stochastic Data Complexity with Boltzmann Influence Functions Nathan Ng Roger C. Grosse Marzyeh Ghassemi 40 0 0 04 Jun 2024
Generative Active Learning for Long-tailed Instance Segmentation Muzhi Zhu Chengxiang Fan Hao Chen Y. Liu Weian Mao Xiaogang Xu Chunhua Shen 50 5 0 04 Jun 2024
Finding NeMo: Localizing Neurons Responsible For Memorization in Diffusion Models Dominik Hintersdorf Lukas Struppek Kristian Kersting Adam Dziedzic Franziska Boenisch 34 11 0 04 Jun 2024
What makes unlearning hard and what to do about it Kairan Zhao M. Kurmanji George-Octavian Barbulescu Eleni Triantafillou Peter Triantafillou MU 60 17 0 03 Jun 2024
Empirical influence functions to understand the logic of fine-tuning Jordan K Matelsky Lyle Ungar Konrad Paul Kording 26 0 0 01 Jun 2024
Scaling Laws for the Value of Individual Data Points in Machine Learning Ian Covert Wenlong Ji Tatsunori Hashimoto James Zou TDI 37 8 0 30 May 2024
Efficient Ensembles Improve Training Data Attribution Junwei Deng Ting-Wei Li Shichang Zhang Jiaqi Ma TDI 35 2 0 27 May 2024
When does compositional structure yield compositional generalization? A kernel theory Samuel Lippl Kim Stachenfeld NAI CoGe 73 5 0 26 May 2024
Data Reconstruction: When You See It and When You Don't Edith Cohen Haim Kaplan Yishay Mansour Shay Moran Kobbi Nissim Uri Stemmer Eliad Tsfadia AAML 42 2 0 24 May 2024
Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approach Huy V. Vo Vasil Khalidov Timothée Darcet Théo Moutakanni Nikita Smetanin ... Maxime Oquab Armand Joulin Hervé Jégou Patrick Labatut Piotr Bojanowski SSL 59 20 0 24 May 2024
Lost in the Averages: A New Specific Setup to Evaluate Membership Inference Attacks Against Machine Learning Models Florent Guépin Natasa Krco Matthieu Meeus Yves-Alexandre de Montjoye 44 1 0 24 May 2024
Data Valuation by Leveraging Global and Local Statistical Information Xiaoling Zhou Ou Wu Michael K. Ng Hao Jiang TDI 30 0 0 23 May 2024
What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functions Sang Keun Choe Hwijeen Ahn Juhan Bae Kewen Zhao Minsoo Kang ... Teruko Mitamura Jeff Schneider Eduard Hovy Roger C. Grosse Eric P. Xing TDI 42 28 0 22 May 2024
Uncertainty-aware Evaluation of Auxiliary Anomalies with the Expected Anomaly Posterior Lorenzo Perini Maja R. Rudolph Sabrina Schmedding Chen Qiu 63 1 0 22 May 2024
Training Data Attribution via Approximate Unrolled Differentiation Juhan Bae Wu Lin Jonathan Lorraine Roger C. Grosse TDI MU 59 12 0 20 May 2024
Quantifying In-Context Reasoning Effects and Memorization Effects in LLMs Siyu Lou Yuntian Chen Xiaodan Liang Liang Lin Quanshi Zhang 42 2 0 20 May 2024
Neural Dynamic Data Valuation Zhangyong Liang Huanhuan Gao Ji Zhang TDI 48 1 0 30 Apr 2024
U Can't Gen This? A Survey of Intellectual Property Protection Methods for Data in Generative AI Tanja Sarcevic Alicja Karlowicz Rudolf Mayer Ricardo A. Baeza-Yates Andreas Rauber 49 6 0 22 Apr 2024
Localizing Paragraph Memorization in Language Models Niklas Stoehr Mitchell Gordon Chiyuan Zhang Owen Lewis MU 38 13 0 28 Mar 2024
FlashEval: Towards Fast and Accurate Evaluation of Text-to-image Diffusion Generative Models Lin Zhao Tianchen Zhao Zinan Lin Xuefei Ning Guohao Dai Huazhong Yang Yu Wang EGVM 55 7 0 25 Mar 2024
A Unified and General Framework for Continual Learning Zhenyi Wang Yan Li Li Shen Heng-Chiao Huang CLL 32 18 0 20 Mar 2024
When Do We Not Need Larger Vision Models? Baifeng Shi Ziyang Wu Maolin Mao Xin Wang Trevor Darrell VLM LRM 54 41 0 19 Mar 2024