Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue

9 January 2024

Papers citing "Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue"

32 / 32 papers shown

Title
Reward Inside the Model: A Lightweight Hidden-State Reward Model for LLM's Best-of-N sampling Jizhou Guo Zhaomin Wu Philip S. Yu 0 0 0 18 May 2025
DeltaEdit: Enhancing Sequential Editing in Large Language Models by Controlling Superimposed Noise Ding Cao Yuchen Cai Rongxi Guo X. He Guiquan Liu KELM 43 0 0 12 May 2025
PropRAG: Guiding Retrieval with Beam Search over Proposition Paths Jingjin Wang LRM 143 0 0 25 Apr 2025
REDEditing: Relationship-Driven Precise Backdoor Poisoning on Text-to-Image Diffusion Models Chongye Guo Jinhu Fu Fan Zhang Kun Wang Guorui Feng 39 0 0 20 Apr 2025
CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learners Yunzhi Yao Jizhan Fang Jia-Chen Gu N. Zhang Shumin Deng H. Chen Nanyun Peng KELM 59 1 0 20 Mar 2025
Knowledge Updating? No More Model Editing! Just Selective Contextual Reasoning Guoxiu He Xin Song Aixin Sun KELM 68 3 0 07 Mar 2025
MindBridge: Scalable and Cross-Model Knowledge Editing via Memory-Augmented Modality Shuaike Li Kai Zhang Qiang Liu Enhong Chen KELM 78 1 0 04 Mar 2025
GeoEdit: Geometric Knowledge Editing for Large Language Models Yujie Feng Liming Zhan Zexin Lu Yongxin Xu Xu Chu Yasha Wang Jiannong Cao Philip S. Yu Xiao-Ming Wu KELM 53 0 0 27 Feb 2025
Constraining Sequential Model Editing with Editing Anchor Compression Hao-Xiang Xu Jun-Yu Ma Zhen-Hua Ling Ningyu Zhang Jia-Chen Gu KELM 49 1 0 25 Feb 2025
CoME: An Unlearning-based Approach to Conflict-free Model Editing Dahyun Jung Jaehyung Seo Jaewook Lee Chanjun Park Heuiseok Lim MU KELM 52 0 0 20 Feb 2025
Reinforced Lifelong Editing for Language Models Zherui Li Houcheng Jiang Hao Chen Baolong Bi Zhenhong Zhou Fei Sun Fan Zhang Qing Guo KELM 56 5 0 09 Feb 2025
AnyEdit: Edit Any Knowledge Encoded in Language Models Houcheng Jiang Fan Zhang Ningyu Zhang Guojun Ma Mingyang Wan Xuben Wang Xiangnan He Tat-Seng Chua KELM 60 8 0 08 Feb 2025
Understanding and Mitigating Gender Bias in LLMs via Interpretable Neuron Editing Zeping Yu Sophia Ananiadou KELM 43 1 0 24 Jan 2025
Knowledge Editing through Chain-of-Thought Changyue Wang Weihang Su Qingyao Ai Yong-Jin Liu KELM 64 1 0 23 Dec 2024
Gumbel Counterfactual Generation From Language Models Shauli Ravfogel Anej Svete Vésteinn Snæbjarnarson Ryan Cotterell LRM CML 33 1 0 11 Nov 2024
O-Edit: Orthogonal Subspace Editing for Language Model Sequential Editing Yuchen Cai Ding Cao KELM 21 3 0 15 Oct 2024
Keys to Robust Edits: from Theoretical Insights to Practical Advances Jianhao Yan Futing Wang Yun Luo Yafu Li Yue Zhang KELM 28 0 0 12 Oct 2024
Neuron-Level Sequential Editing for Large Language Models Houcheng Jiang Fan Zhang Tianyu Zhang An Zhang Ruipeng Wang Tao Liang Xiang Wang KELM 48 4 0 05 Oct 2024
AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models Fan Zhang Houcheng Jiang Kun Wang Yunshan Ma Shi Jie Xiangnan He Tat-Seng Chua Tat-seng Chua KELM 39 34 0 03 Oct 2024
Composable Interventions for Language Models Arinbjorn Kolbeinsson Kyle O'Brien Tianjin Huang Shanghua Gao Shiwei Liu ... Anurag J. Vaidya Faisal Mahmood Marinka Zitnik Tianlong Chen Thomas Hartvigsen KELM MU 89 5 0 09 Jul 2024
MEMoE: Enhancing Model Editing with Mixture of Experts Adaptors Renzhi Wang Piji Li KELM 38 3 0 29 May 2024
Perturbation-Restrained Sequential Model Editing Junjie Ma Hong Wang Haoyang Xu Zhen-Hua Ling Jia-Chen Gu KELM 59 8 0 27 May 2024
Anchored Answers: Unravelling Positional Bias in GPT-2's Multiple-Choice Questions Ruizhe Li Yanjun Gao KELM 32 5 0 06 May 2024
InstructEdit: Instruction-based Knowledge Editing for Large Language Models Ningyu Zhang Bo Tian Siyuan Cheng Xiaozhuan Liang Yi Hu Kouying Xue Yanjie Gou Xi Chen Huajun Chen KELM 48 4 0 25 Feb 2024
Neighboring Perturbations of Knowledge Editing on Large Language Models Jun-Yu Ma Zhen-Hua Ling Ningyu Zhang Jia-Chen Gu KELM 31 5 0 31 Jan 2024
SWEA: Updating Factual Knowledge in Large Language Models via Subject Word Embedding Altering Xiaopeng Li Shasha Li Shezheng Song Huijun Liu Bing Ji ... Jun Ma Jie Yu Xiaodong Liu Jing Wang Weimin Zhang KELM 45 4 0 31 Jan 2024
Sowing the Wind, Reaping the Whirlwind: The Impact of Editing Language Models Rima Hazra Sayan Layek Somnath Banerjee Soujanya Poria KELM 34 17 0 19 Jan 2024
Knowledge Editing for Large Language Models: A Survey Song Wang Yaochen Zhu Haochen Liu Zaiyi Zheng Chen Chen Wenlin Yao KELM 71 133 0 24 Oct 2023
Untying the Reversal Curse via Bidirectional Language Model Editing Jun-Yu Ma Jia-Chen Gu Zhen-Hua Ling Quan Liu Cong Liu KELM 79 36 0 16 Oct 2023
Fast Model Editing at Scale E. Mitchell Charles Lin Antoine Bosselut Chelsea Finn Christopher D. Manning KELM 230 343 0 21 Oct 2021
Analyzing Commonsense Emergence in Few-shot Knowledge Models Jeff Da Ronan Le Bras Ximing Lu Yejin Choi Antoine Bosselut AI4MH KELM 64 40 0 01 Jan 2021
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 198 181 0 03 Sep 2019