Topology of Word Embeddings: Singularities Reflect Polysemy

18 November 2020

Papers citing "Topology of Word Embeddings: Singularities Reflect Polysemy"

17 / 17 papers shown

Title
Token embeddings violate the manifold hypothesis Michael Robinson Sourya Dey Tony Chiang 69 2 0 01 Apr 2025
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 359 24,160 0 26 Jul 2019
ERNIE: Enhanced Representation through Knowledge Integration Yu Sun Shuohuan Wang Yukun Li Shikun Feng Xuyi Chen Han Zhang Xin Tian Danxiang Zhu Hao Tian Hua Wu 92 898 0 19 Apr 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 815 93,936 0 11 Oct 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 81 11,520 0 15 Feb 2018
Learned in Translation: Contextualized Word Vectors Bryan McCann James Bradbury Caiming Xiong R. Socher 93 907 0 01 Aug 2017
Representing Sentences as Low-Rank Subspaces Jiaqi Mu S. Bhat Pramod Viswanath 68 27 0 18 Apr 2017
Geometry of Polysemy Jiaqi Mu S. Bhat Pramod Viswanath 43 21 0 24 Oct 2016
Enriching Word Vectors with Subword Information Piotr Bojanowski Edouard Grave Armand Joulin Tomas Mikolov NAI SSL VLM 179 9,924 0 15 Jul 2016
Linear Algebraic Structure of Word Senses, with Applications to Polysemy Sanjeev Arora Yuanzhi Li Yingyu Liang Tengyu Ma Andrej Risteski 59 273 0 14 Jan 2016
Efficient Non-parametric Estimation of Multiple Embeddings per Word in Vector Space Arvind Neelakantan Jeevan Shankar Alexandre Passos Andrew McCallum 52 464 0 24 Apr 2015
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 258 33,445 0 16 Oct 2013
Testing the Manifold Hypothesis Charles Fefferman S. Mitter Hariharan Narayanan 68 523 0 01 Oct 2013
KSU KDD: Word Sense Induction by Clustering in Topic Space Wesam Elshamy Doina Caragea W. Hsu 36 12 0 28 Feb 2013
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 510 31,406 0 16 Jan 2013
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 137 12,384 0 24 Jun 2012
Natural Language Processing (almost) from Scratch R. Collobert Jason Weston Léon Bottou Michael Karlen Koray Kavukcuoglu Pavel P. Kuksa 107 7,711 0 02 Mar 2011