On the Emergence of Linear Analogies in Word Embeddings

24 May 2025

Papers citing "On the Emergence of Linear Analogies in Word Embeddings"

20 / 20 papers shown

Title
Probing the Latent Hierarchical Structure of Data via Diffusion Models Antonio Sclocchi Alessandro Favero Noam Itzhak Levi Matthieu Wyart DiffM 52 5 0 17 Oct 2024
The Geometry of Categorical and Hierarchical Concepts in Large Language Models Kiho Park Yo Joong Choe Yibo Jiang Victor Veitch 59 35 0 03 Jun 2024
On the Origins of Linear Representations in Large Language Models Yibo Jiang Goutham Rajendran Pradeep Ravikumar Bryon Aragam Victor Veitch 74 29 0 06 Mar 2024
A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Data Antonio Sclocchi Alessandro Favero Matthieu Wyart DiffM 51 28 0 26 Feb 2024
A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity Andrew Lee Xiaoyan Bai Itamar Pres Martin Wattenberg Jonathan K. Kummerfeld Rada Mihalcea 84 108 0 03 Jan 2024
The Linear Representation Hypothesis and the Geometry of Large Language Models Kiho Park Yo Joong Choe Victor Veitch LLMSV MILM 75 162 0 07 Nov 2023
Function Vectors in Large Language Models Eric Todd Millicent Li Arnab Sen Sharma Aaron Mueller Byron C. Wallace David Bau 25 111 0 23 Oct 2023
Language Models Represent Space and Time Wes Gurnee Max Tegmark 75 151 0 03 Oct 2023
Emergent Linear Representations in World Models of Self-Supervised Sequence Models Neel Nanda Andrew Lee Martin Wattenberg FAtt MILM 61 165 0 02 Sep 2023
How Deep Neural Networks Learn Compositional Data: The Random Hierarchy Model Francesco Cagnetta Leonardo Petrini Umberto M. Tomasini Alessandro Favero Matthieu Wyart BDL 35 24 0 05 Jul 2023
Inference-Time Intervention: Eliciting Truthful Answers from a Language Model Kenneth Li Oam Patel Fernanda Viégas Hanspeter Pfister Martin Wattenberg KELM HILM 62 528 0 06 Jun 2023
Language Models Implement Simple Word2Vec-style Vector Arithmetic Jack Merullo Carsten Eickhoff Ellie Pavlick KELM 44 59 0 25 May 2023
How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding Yuchen Li Yuan-Fang Li Andrej Risteski 130 63 0 07 Mar 2023
Concept Algebra for (Score-Based) Text-Controlled Generative Models Zihao Wang Lin Gui Jeffrey Negrea Victor Veitch CoGe DiffM 47 34 0 07 Feb 2023
Editing Models with Task Arithmetic Gabriel Ilharco Marco Tulio Ribeiro Mitchell Wortsman Suchin Gururangan Ludwig Schmidt Hannaneh Hajishirzi Ali Farhadi KELM MoMe MU 99 462 0 08 Dec 2022
A General Framework for Implicit and Explicit Debiasing of Distributional Word Vector Spaces Anne Lauscher Goran Glavaš Simone Paolo Ponzetto Ivan Vulić 34 64 0 13 Sep 2019
Analogies Explained: Towards Understanding Word Embeddings Carl Allen Timothy M. Hospedales 24 144 0 28 Jan 2019
Towards Understanding Linear Word Analogies Kawin Ethayarajh David Duvenaud Graeme Hirst 20 114 0 11 Oct 2018
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 192 33,445 0 16 Oct 2013
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 472 31,406 0 16 Jan 2013