Linear Algebraic Structure of Word Senses, with Applications to Polysemy

14 January 2016

Andrej Risteski

Papers citing "Linear Algebraic Structure of Word Senses, with Applications to Polysemy"

36 / 36 papers shown

Title
Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition Zhengfu He J. Wang Rui Lin Xuyang Ge Wentao Shu Qiong Tang Junzhe Zhang Xipeng Qiu 70 0 0 29 Apr 2025
I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data? Yuhang Liu Dong Gong Erdun Gao Zhen Zhang Zhen Zhang Biwei Huang Anton van den Hengel Javen Qinfeng Shi Javen Qinfeng Shi 157 0 0 12 Mar 2025
Semantic Wave Functions: Exploring Meaning in Large Language Models Through Quantum Formalism Timo Aukusti Laine 39 1 0 09 Mar 2025
Superscopes: Amplifying Internal Feature Representations for Language Model Interpretation Jonathan Jacobi Gal Niv LRM ReLM 60 0 0 03 Mar 2025
The Representation and Recall of Interwoven Structured Knowledge in LLMs: A Geometric and Layered Analysis Ge Lei Samuel J. Cooper KELM 49 0 0 15 Feb 2025
The Complexity of Learning Sparse Superposed Features with Feedback Akash Kumar 158 0 0 08 Feb 2025
Out-of-distribution generalization via composition: a lens through induction heads in Transformers Jiajun Song Zhuoyan Xu Yiqiao Zhong 85 4 0 31 Dec 2024
CodeUnlearn: Amortized Zero-Shot Machine Unlearning in Language Models Using Discrete Concept YuXuan Wu Bonaventure F. P. Dossou Dianbo Liu MU 21 0 0 08 Oct 2024
On the Complexity of Neural Computation in Superposition Micah Adler Nir Shavit 115 3 0 05 Sep 2024
The Geometry of Categorical and Hierarchical Concepts in Large Language Models Kiho Park Yo Joong Choe Yibo Jiang Victor Veitch 50 26 0 03 Jun 2024
Codebook Features: Sparse and Discrete Interpretability for Neural Networks Alex Tamkin Mohammad Taufeeque Noah D. Goodman 32 27 0 26 Oct 2023
Reverse Engineering Self-Supervised Learning Ido Ben-Shaul Ravid Shwartz-Ziv Tomer Galanti S. Dekel Yann LeCun SSL 23 34 0 24 May 2023
Discovering Universal Geometry in Embeddings with ICA Hiroaki Yamagiwa Momose Oyama Hidetoshi Shimodaira 25 13 0 22 May 2023
Shades of meaning: Uncovering the geometry of ambiguous word representations through contextualised language models Benedetta Cevoli C. Watkins Yang Gao K. Rastle 29 3 0 26 Apr 2023
Word Sense Induction with Knowledge Distillation from BERT Anik Saha Alex Gittens B. Yener 10 1 0 20 Apr 2023
Tsetlin Machine Embedding: Representing Words Using Logical Expressions Bimal Bhattarai Ole-Christoffer Granmo Lei Jiao Rohan Kumar Yadav Jivitesh Sharma NAI 14 12 0 02 Jan 2023
Schrödinger's Bat: Diffusion Models Sometimes Generate Polysemous Words in Superposition Jennifer C. White Ryan Cotterell DiffM 30 5 0 23 Nov 2022
To Know by the Company Words Keep and What Else Lies in the Vicinity Jake Williams H. Heidenreich 16 0 0 30 Apr 2022
From Pivots to Graphs: Augmented CycleDensity as a Generalization to One Time InverseConsultation Shashwat Goel K. Grover 25 2 0 27 Aug 2021
Theoretical foundations and limits of word embeddings: what types of meaning can they capture? Alina Arseniev-Koehler 28 19 0 22 Jul 2021
Integrating topic modeling and word embedding to characterize violent deaths Alina Arseniev-Koehler S. Cochran V. Mays Kai-Wei Chang J. Foster 27 31 0 28 Jun 2021
Improving Entity Linking through Semantic Reinforced Entity Embeddings Feng Hou Ruili Wang Jun He Yi Zhou AI4TS 18 39 0 16 Jun 2021
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning Zixin Wen Yuanzhi Li SSL MLT 29 131 0 31 May 2021
SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts Arie Cattan Sophie Johnson Daniel S. Weld Ido Dagan Iz Beltagy Doug Downey Tom Hope 20 23 0 18 Apr 2021
Ultra-High Dimensional Sparse Representations with Binarization for Efficient Text Retrieval Kyoung-Rok Jang Junmo Kang Giwon Hong Sung-Hyon Myaeng Joohee Park Taewon Yoon Heecheol Seo 31 20 0 15 Apr 2021
Low-skilled Occupations Face the Highest Upskilling Pressure Di Tong Lingfei Wu James Allen Evans 24 0 0 27 Jan 2021
Cultural Cartography with Word Embeddings Dustin S. Stoltz Marshall A. Taylor 23 38 0 09 Jul 2020
Feature Purification: How Adversarial Training Performs Robust Deep Learning Zeyuan Allen-Zhu Yuanzhi Li MLT AAML 29 147 0 20 May 2020
Machine learning as a model for cultural learning: Teaching an algorithm what it means to be fat Alina Arseniev-Koehler J. Foster 43 46 0 24 Mar 2020
What do you mean, BERT? Assessing BERT as a Distributional Semantics Model Timothee Mickus Denis Paperno Mathieu Constant Kees van Deemter 21 45 0 13 Nov 2019
SECNLP: A Survey of Embeddings in Clinical Natural Language Processing Katikapalli Subramanyam Kalyan S. Sangeetha 17 82 0 04 Mar 2019
Imparting Interpretability to Word Embeddings while Preserving Semantic Structure Lutfi Kerem Senel Ihsan Utlu Furkan Şahinuç H. Ozaktas Aykut Kocc 24 14 0 19 Jul 2018
A La Carte Embedding: Cheap but Effective Induction of Semantic Feature Vectors M. Khodak Nikunj Saunshi Yingyu Liang Tengyu Ma Brandon M Stewart Sanjeev Arora 36 98 0 14 May 2018
AspEm: Embedding Learning by Aspects in Heterogeneous Information Networks Yu Shi Huan Gui Qi Zhu Lance M. Kaplan Jiawei Han 19 83 0 05 Mar 2018
Geometry of Polysemy Jiaqi Mu S. Bhat Pramod Viswanath 22 21 0 24 Oct 2016
From Frequency to Meaning: Vector Space Models of Semantics Peter D. Turney Patrick Pantel 84 2,980 0 04 Mar 2010