Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs

Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs

13 June 2024

Wei Peng

Alexandra Birch

Papers citing "Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs"

8 / 8 papers shown

Title
Polysemy of Synthetic Neurons Towards a New Type of Explanatory Categorical Vector Spaces Michael Pichat William Pogrund Paloma Pichat Judicael Poumay Armanouche Gasparian Samuel Demarchi Martin Corbet Alois Georgeon Michael Veillet-Guillem MILM 29 0 0 30 Apr 2025
Localized Cultural Knowledge is Conserved and Controllable in Large Language Models V. Veselovsky Berke Argin Benedikt Stroebl Chris Wendler Robert West James Evans Thomas L. Griffiths Arvind Narayanan 57 0 0 14 Apr 2025
Investigating Neurons and Heads in Transformer-based LLMs for Typographical Errors Kohei Tsuji Tatsuya Hiraoka Yuchang Cheng Eiji Aramaki Tomoya Iwakura 79 0 0 27 Feb 2025
On Relation-Specific Neurons in Large Language Models Yihong Liu Runsheng Chen Lea Hirlimann Ahmad Dawar Hakimi Mingyang Wang Amir Hossein Kargaran S. Rothe François Yvon Hinrich Schütze KELM 41 0 0 24 Feb 2025
AdaCoT: Rethinking Cross-Lingual Factual Reasoning through Adaptive Chain-of-Thought Xin Huang Tarun K. Vangani Zhengyuan Liu Bowei Zou A. Aw LRM AI4CE 55 2 0 27 Jan 2025
Semantics-Adaptive Activation Intervention for LLMs via Dynamic Steering Vectors Weixuan Wang J. Yang Wei Peng LLMSV 28 3 0 16 Oct 2024
Unveiling Language Competence Neurons: A Psycholinguistic Approach to Model Interpretability Xufeng Duan Xinyu Zhou Bei Xiao Zhenguang G. Cai MILM 38 3 0 24 Sep 2024
Low-Redundant Optimization for Large Language Model Alignment Zhipeng Chen Kun Zhou Wayne Xin Zhao Jingyuan Wang Ji-Rong Wen 36 2 0 18 Jun 2024