Mass-Editing Memory in a Transformer

13 October 2022

Papers citing "Mass-Editing Memory in a Transformer"

50 / 412 papers shown

Title
Backdoor in Seconds: Unlocking Vulnerabilities in Large Pre-trained Models via Model Editing Dongliang Guo Mengxuan Hu Zihan Guan Junfeng Guo Thomas Hartvigsen Sheng Li AAML 33 0 0 23 Oct 2024
Interpreting token compositionality in LLMs: A robustness analysis Nura Aljaafari Danilo S. Carvalho André Freitas 35 0 0 16 Oct 2024
O-Edit: Orthogonal Subspace Editing for Language Model Sequential Editing Yuchen Cai Ding Cao KELM 21 3 0 15 Oct 2024
ChroKnowledge: Unveiling Chronological Knowledge of Language Models in Multiple Domains Yein Park Chanwoong Yoon Jungwoo Park Donghyeon Lee Minbyul Jeong Jaewoo Kang KELM 64 1 0 13 Oct 2024
Keys to Robust Edits: from Theoretical Insights to Practical Advances Jianhao Yan Futing Wang Yun Luo Yafu Li Yue Zhang KELM 28 0 0 12 Oct 2024
CollabEdit: Towards Non-destructive Collaborative Knowledge Editing Jiamu Zheng Jinghuai Zhang Tianyu Du Xuhong Zhang Jianwei Yin Tao Lin KELM 40 0 0 12 Oct 2024
Understanding the Interplay between Parametric and Contextual Knowledge for Large Language Models Sitao Cheng Liangming Pan Xunjian Yin Xinyi Wang William Yang Wang KELM 39 4 0 10 Oct 2024
Uncovering Overfitting in Large Language Model Editing Mengqi Zhang Xiaotian Ye Qiang Liu Pengjie Ren Shu Wu Zhumin Chen KELM 39 8 0 10 Oct 2024
Dissecting Fine-Tuning Unlearning in Large Language Models Yihuai Hong Yuelin Zou Lijie Hu Ziqian Zeng Di Wang Haiqin Yang AAML MU 45 2 0 09 Oct 2024
Locate-then-edit for Multi-hop Factual Recall under Knowledge Editing Zhuoran Zhang Yong Li Zijian Kan Keyuan Cheng Lijie Hu Di Wang KELM 29 4 0 08 Oct 2024
FAME: Towards Factual Multi-Task Model Editing Li Zeng Yingyu Shan Zeming Liu Jiashu Yao Yuhang Guo KELM 31 1 0 07 Oct 2024
MINER: Mining the Underlying Pattern of Modality-Specific Neurons in Multimodal Large Language Models Kaichen Huang Jiahao Huo Yibo Yan Kun Wang Yutao Yue Xuming Hu 39 2 0 07 Oct 2024
Neuron-Level Sequential Editing for Large Language Models Houcheng Jiang Junfeng Fang Tianyu Zhang An Zhang Ruipeng Wang Tao Liang Xiang Wang KELM 51 4 0 05 Oct 2024
RIPPLECOT: Amplifying Ripple Effect of Knowledge Editing in Language Models via Chain-of-Thought In-Context Learning Zihao Zhao Yuchen Yang Yijiang Li Yinzhi Cao LRM KELM 35 1 0 04 Oct 2024
HiddenGuard: Fine-Grained Safe Generation with Specialized Representation Router Lingrui Mei Shenghua Liu Yiwei Wang Baolong Bi Ruibin Yuan Xueqi Cheng 35 4 0 03 Oct 2024
Defining Knowledge: Bridging Epistemology and Large Language Models Constanza Fierro Ruchira Dhar Filippos Stamatiou Nicolas Garneau Anders Søgaard KELM 28 4 0 03 Oct 2024
Better Call SAUL: Fluent and Consistent Language Model Editing with Generation Regularization Mingyang Wang Lukas Lange Heike Adel Jannik Strötgen Hinrich Schütze KELM 28 2 0 03 Oct 2024
AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models Junfeng Fang Houcheng Jiang Kun Wang Yunshan Ma Shi Jie Xiangnan He Tat-Seng Chua Tat-seng Chua KELM 39 34 0 03 Oct 2024
Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering Yu Zhang Kehai Chen Xuefeng Bai zhao kang Quanjiang Guo Min Zhang 31 6 0 02 Oct 2024
Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis Reshmi Ghosh Rahul Seetharaman Hitesh Wadhwa Somyaa Aggarwal Samyadeep Basu Soundararajan Srinivasan Wenlong Zhao Shreyas Chaudhari Ehsan Aghazadeh 30 0 0 01 Oct 2024
UniAdapt: A Universal Adapter for Knowledge Calibration Tai D. Nguyen Long H. Pham Jun Sun KELM 30 0 0 01 Oct 2024
Towards Unified Multimodal Editing with Enhanced Knowledge Collaboration Kaihang Pan Zhaoyu Fan Juncheng Li Qifan Yu Hao Fei Siliang Tang Richang Hong Hanwang Zhang Qianru Sun KELM 33 6 0 30 Sep 2024
Identifying Knowledge Editing Types in Large Language Models Xiaopeng Li Shangwen Wang Shezheng Song Bin Ji Huijun Liu Shasha Li Jun Ma Jie Yu KELM 31 1 0 29 Sep 2024
Crafting Personalized Agents through Retrieval-Augmented Generation on Editable Memory Graphs Zheng Wang Zhongyang Li Zeren Jiang Dandan Tu Wei Shi 52 7 0 28 Sep 2024
"Why" Has the Least Side Effect on Model Editing Tsung-Hsuan Pan Chung-Chi Chen Hen-Hsen Huang Hsin-Hsi Chen KELM 26 1 0 27 Sep 2024
Interpreting Arithmetic Mechanism in Large Language Models through Comparative Neuron Analysis Zeping Yu Sophia Ananiadou LRM MILM 27 7 0 21 Sep 2024
Co-occurrence is not Factual Association in Language Models Xiao Zhang Miao Li Ji Wu KELM 68 2 0 21 Sep 2024
Towards LifeSpan Cognitive Systems Yu Wang Chi Han Tongtong Wu Xiaoxin He Wangchunshu Zhou ... Zexue He Wei Wang Gholamreza Haffari Heng Ji Julian McAuley KELM CLL 170 1 0 20 Sep 2024
LLM Surgery: Efficient Knowledge Unlearning and Editing in Large Language Models Akshaj Kumar Veldanda Shi-Xiong Zhang Anirban Das Supriyo Chakraborty Stephen Rawls Sambit Sahu Milind Naphade KELM MU 36 0 0 19 Sep 2024
MQA-KEAL: Multi-hop Question Answering under Knowledge Editing for Arabic Language Muhammad Asif Ali Nawal Daftardar Mutayyaba Waheed Jianbin Qin Di Wang KELM 37 1 0 18 Sep 2024
StruEdit: Structured Outputs Enable the Fast and Accurate Knowledge Editing for Large Language Models Baolong Bi Shenghua Liu Yiwei Wang Lingrui Mei Hongcheng Gao Junfeng Fang Xueqi Cheng KELM 47 8 0 16 Sep 2024
Synthetic continued pretraining Zitong Yang Neil Band Shuangping Li Emmanuel Candès Tatsunori Hashimoto CLL SyDa 41 11 0 11 Sep 2024
Evaluating Open-Source Sparse Autoencoders on Disentangling Factual Knowledge in GPT-2 Small Maheep Chaudhary Atticus Geiger 26 13 0 05 Sep 2024
Does Knowledge Localization Hold True? Surprising Differences Between Entity and Relation Perspectives in Language Models Yifan Wei Xiaoyan Yu Yixuan Weng Huanhuan Ma Yuanzhe Zhang Jun Zhao Kang Liu KELM 64 4 0 01 Sep 2024
Novel-WD: Exploring acquisition of Novel World Knowledge in LLMs Using Prefix-Tuning Maxime Méloux Christophe Cerisara KELM CLL 32 0 0 30 Aug 2024
Relation Also Knows: Rethinking the Recall and Editing of Factual Associations in Auto-Regressive Transformer Language Models Xiyu Liu Zhengxiao Liu Naibin Gu Zheng-Shen Lin Wanli Ma Ji Xiang Weiping Wang KELM 46 0 0 27 Aug 2024
Enhancing Multi-hop Reasoning through Knowledge Erasure in Large Language Model Editing Mengqi Zhang Bowen Fang Qiang Liu Pengjie Ren Shu Wu Zhumin Chen Liang Wang KELM 23 3 0 22 Aug 2024
MEGen: Generative Backdoor in Large Language Models via Model Editing Jiyang Qiu Xinbei Ma Zhuosheng Zhang Hai Zhao AAML KELM SILM 30 3 0 20 Aug 2024
Beneath the Surface of Consistency: Exploring Cross-lingual Knowledge Representation Sharing in LLMs Maxim Ifergan Leshem Choshen Roee Aharoni Idan Szpektor Omri Abend HILM 51 3 0 20 Aug 2024
Promoting Equality in Large Language Models: Identifying and Mitigating the Implicit Bias based on Bayesian Theory Yongxin Deng Xihe Qiu Xiaoyu Tan Jing Pan Chen Jue Zhijun Fang Yinghui Xu Wei Chu Yuan Qi 34 3 0 20 Aug 2024
Resolving Lexical Bias in Edit Scoping with Projector Editor Networks Hammad Rizwan Domenic Rosati Ga Wu Hassan Sajjad KELM 36 0 0 19 Aug 2024
Attribution Analysis Meets Model Editing: Advancing Knowledge Correction in Vision Language Models with VisEdit Qizhou Chen Taolin Zhang Chengyu Wang Xiaofeng He Dakan Wang Tingting Liu KELM 54 3 0 19 Aug 2024
Lower Layer Matters: Alleviating Hallucination via Multi-Layer Fusion Contrastive Decoding with Truthfulness Refocused Dingwei Chen Feiteng Fang Shiwen Ni Feng Liang Ruifeng Xu Min Yang Chengming Li HILM 31 2 0 16 Aug 2024
Knowledge in Superposition: Unveiling the Failures of Lifelong Knowledge Editing for Large Language Models Chenhui Hu Pengfei Cao Yubo Chen Kang Liu Jun Zhao KELM 61 2 0 14 Aug 2024
Get Confused Cautiously: Textual Sequence Memorization Erasure with Selective Entropy Maximization Zhaohan Zhang Ziquan Liu Ioannis Patras 39 2 0 09 Aug 2024
Generalisation First, Memorisation Second? Memorisation Localisation for Natural Language Classification Tasks Verna Dankers Ivan Titov 45 5 0 09 Aug 2024
The Mechanics of Conceptual Interpretation in GPT Models: Interpretative Insights Nura Aljaafari Danilo S. Carvalho André Freitas KELM 40 0 0 05 Aug 2024
The Quest for the Right Mediator: A History, Survey, and Theoretical Grounding of Causal Interpretability Aaron Mueller Jannik Brinkmann Millicent Li Samuel Marks Koyena Pal ... Arnab Sen Sharma Jiuding Sun Eric Todd David Bau Yonatan Belinkov CML 52 18 0 02 Aug 2024
Can LLMs be Fooled? Investigating Vulnerabilities in LLMs Sara Abdali Jia He C. Barberan Richard Anarfi 36 7 0 30 Jul 2024
Can Editing LLMs Inject Harm? Canyu Chen Baixiang Huang Zekun Li Zhaorun Chen Shiyang Lai ... Xifeng Yan William Wang Philip Torr Dawn Song Kai Shu KELM 44 11 0 29 Jul 2024