Can Neural Network Memorization Be Localized?

18 July 2023

J. Zico Kolter

Papers citing "Can Neural Network Memorization Be Localized?"

37 / 37 papers shown

Title
How Does Overparameterization Affect Machine Unlearning of Deep Neural Networks? Gal Alon Yehuda Dar MU AI4CE 58 0 0 11 Mar 2025
Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyond Qiongxiu Li Xiaoyu Luo Yiyi Chen Johannes Bjerva 48 0 0 10 Mar 2025
On Memorization in Diffusion Models Xiangming Gu Chao Du Tianyu Pang Chongxuan Li Min-Bin Lin Ye Wang DiffM TDI 166 43 0 21 Feb 2025
Robust Concept Erasure Using Task Vectors Minh Pham Kelly O. Marshall Chinmay Hegde Niv Cohen 120 17 0 21 Feb 2025
FairDropout: Using Example-Tied Dropout to Enhance Generalization of Minority Groups Géraldin Nanfack Eugene Belilovsky 59 0 0 10 Feb 2025
The Silent Majority: Demystifying Memorization Effect in the Presence of Spurious Correlations Chenyu You Haocheng Dai Yifei Min Jasjeet Sekhon S. Joshi James S. Duncan 65 2 0 01 Jan 2025
The Pitfalls of Memorization: When Memorization Hurts Generalization Reza Bayat Mohammad Pezeshki Elvis Dohmatob David Lopez-Paz Pascal Vincent OOD 105 3 0 10 Dec 2024
CopyrightShield: Spatial Similarity Guided Backdoor Defense against Copyright Infringement in Diffusion Models Zhixiang Guo Siyuan Liang Aishan Liu Dacheng Tao AAML 76 1 0 02 Dec 2024
Detecting Memorization in Large Language Models Eduardo Slonski 75 0 0 02 Dec 2024
FLARE: Towards Universal Dataset Purification against Backdoor Attacks Linshan Hou Wei Luo Zhongyun Hua Songhua Chen L. Zhang Yiming Li AAML 70 0 0 29 Nov 2024
DEAN: Deactivating the Coupled Neurons to Mitigate Fairness-Privacy Conflicts in Large Language Models Chen Qian Dongrui Liu Jie Zhang Yong Liu Jing Shao 37 1 0 22 Oct 2024
MUSO: Achieving Exact Machine Unlearning in Over-Parameterized Regimes Ruikai Yang M. He Zhengbao He Youmei Qiu X. Huang MU BDL 39 1 0 11 Oct 2024
More Experts Than Galaxies: Conditionally-overlapping Experts With Biologically-Inspired Fixed Routing Sagi Shaier Francisco Pereira K. Wense Lawrence E Hunter Matt Jones MoE 46 0 0 10 Oct 2024
Mitigating Memorization In Language Models Mansi Sakarvadia Aswathy Ajith Arham Khan Nathaniel Hudson Caleb Geniesse Kyle Chard Yaoqing Yang Ian Foster Michael W. Mahoney KELM MU 58 0 0 03 Oct 2024
Localizing Memorization in SSL Vision Encoders Wenhao Wang Adam Dziedzic Michael Backes Franziska Boenisch 34 2 0 27 Sep 2024
SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization Kohei Tsuji Tatsuya Hiraoka Yuchang Cheng Tomoya Iwakura 40 1 0 10 Sep 2024
Generalisation First, Memorisation Second? Memorisation Localisation for Natural Language Classification Tasks Verna Dankers Ivan Titov 45 5 0 09 Aug 2024
The Phantom Menace: Unmasking Privacy Leakages in Vision-Language Models Simone Caldarella Massimiliano Mancini Elisa Ricci Rahaf Aljundi PILM 48 1 0 02 Aug 2024
Demystifying Verbatim Memorization in Large Language Models Jing Huang Diyi Yang Christopher Potts ELM PILM MU 55 19 0 25 Jul 2024
PII-Compass: Guiding LLM training data extraction prompts towards the target PII via grounding K. K. Nakka Ahmed Frikha Ricardo Mendes Xue Jiang Xuebing Zhou 29 7 0 03 Jul 2024
Causal Estimation of Memorisation Profiles Pietro Lesci Clara Meister Thomas Hofmann Andreas Vlachos Tiago Pimentel 45 5 0 06 Jun 2024
Memorization in deep learning: A survey Jiaheng Wei Yanjun Zhang Leo Yu Zhang Ming Ding Chao Chen Kok-Leong Ong Jun Zhang Yang Xiang 47 6 0 06 Jun 2024
Finding NeMo: Localizing Neurons Responsible For Memorization in Diffusion Models Dominik Hintersdorf Lukas Struppek Kristian Kersting Adam Dziedzic Franziska Boenisch 34 11 0 04 Jun 2024
Memorized Images in Diffusion Models share a Subspace that can be Located and Deleted Ruchika Chavhan Ondrej Bohdal Yongshuo Zong Da Li Timothy M. Hospedales 31 4 0 01 Jun 2024
When does compositional structure yield compositional generalization? A kernel theory Samuel Lippl Kim Stachenfeld NAI CoGe 73 5 0 26 May 2024
Towards Natural Machine Unlearning Zhengbao He Tao Li Xinwen Cheng Zhehao Huang Xiaolin Huang MU 28 3 0 24 May 2024
Learnable Privacy Neurons Localization in Language Models Ruizhe Chen Tianxiang Hu Yang Feng Zuo-Qiang Liu 44 12 0 16 May 2024
PreCurious: How Innocent Pre-Trained Language Models Turn into Privacy Traps Ruixuan Liu Tianhao Wang Yang Cao Li Xiong AAML SILM 53 15 0 14 Mar 2024
Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications Boyi Wei Kaixuan Huang Yangsibo Huang Tinghao Xie Xiangyu Qi Mengzhou Xia Prateek Mittal Mengdi Wang Peter Henderson AAML 57 79 0 07 Feb 2024
Memorization in Self-Supervised Learning Improves Downstream Generalization Wenhao Wang Muhammad Ahmad Kaleem Adam Dziedzic Michael Backes Nicolas Papernot Franziska Boenisch SSL 19 9 0 19 Jan 2024
Do Localization Methods Actually Localize Memorized Data in LLMs? A Tale of Two Benchmarks Ting-Yun Chang Jesse Thomason Robin Jia 15 14 0 15 Nov 2023
SoK: Memorisation in machine learning Dmitrii Usynin Moritz Knolle Georgios Kaissis 19 1 0 06 Nov 2023
SoK: Memorization in General-Purpose Large Language Models Valentin Hartmann Anshuman Suri Vincent Bindschaedler David E. Evans Shruti Tople Robert West KELM LLMAG 16 20 0 24 Oct 2023
What do larger image classifiers memorise? Michal Lukasik Vaishnavh Nagarajan A. S. Rawat A. Menon Sanjiv Kumar 30 5 0 09 Oct 2023
Backdoor Federated Learning by Poisoning Backdoor-Critical Layers Haomin Zhuang Mingxian Yu Hao Wang Yang Hua Jian Li Xu Yuan FedML 26 9 0 08 Aug 2023
Layer-wise Linear Mode Connectivity Linara Adilova Maksym Andriushchenko Michael Kamp Asja Fischer Martin Jaggi FedML FAtt MoMe 33 15 0 13 Jul 2023
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 290 1,815 0 14 Dec 2020