Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses

29 April 2021

Marianna Apidianaki

Papers citing "Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses"

35 / 35 papers shown

Title
Linguistic Interpretability of Transformer-based Language Models: a systematic review Miguel López-Otal Jorge Gracia Jordi Bernad Carlos Bobed Lucía Pitarch-Ballesteros Emma Anglés-Herrero VLM 36 0 0 09 Apr 2025
The cell as a token: high-dimensional geometry in language models and cell embeddings William Gilpin 79 0 0 26 Mar 2025
DBudgetKV: Dynamic Budget in KV Cache Compression for Ensuring Optimal Performance Xuanfan Ni Liyan Xu Chenyang Lyu Longyue Wang Mo Yu Lemao Liu Fandong Meng Jie Zhou Piji Li 53 0 0 24 Feb 2025
Tracing the Development of the Virtual Particle Concept Using Semantic Change Detection Michael Zichert Adrian Wüthrich 25 1 0 22 Oct 2024
Locally Measuring Cross-lingual Lexical Alignment: A Domain and Word Level Perspective Taelin Karidi Eitan Grossman Omri Abend 26 1 0 07 Oct 2024
Word-specific tonal realizations in Mandarin Yu-Ying Chuang Melanie J. Bell Yu-Hsiang Tseng R. Baayen 43 5 0 11 May 2024
Analyzing Semantic Change through Lexical Replacements Francesco Periti Pierluigi Cassotti Haim Dubossarsky Nina Tahmasebi 57 6 0 29 Apr 2024
Adjusting Interpretable Dimensions in Embedding Space with Human Judgments Katrin Erk Marianna Apidianaki 24 3 0 03 Apr 2024
The Impact of Word Splitting on the Semantic Content of Contextualized Word Representations Aina Garí Soler Matthieu Labeau Chloé Clavel VLM 42 2 0 22 Feb 2024
Systematic word meta-sense extension Lei Yu 28 1 0 21 Nov 2023
Construction Grammar and Language Models Harish Tayyar Madabushi Laurence Romain P. Milin Dagmar Divjak 23 5 0 25 Aug 2023
Do Language Models' Words Refer? M. Mandelkern Tal Linzen LRM 4 18 0 10 Aug 2023
Evaluating Biased Attitude Associations of Language Models in an Intersectional Context Shiva Omrani Sabbaghi Robert Wolfe Aylin Caliskan 26 22 0 07 Jul 2023
ICSVR: Investigating Compositional and Syntactic Understanding in Video Retrieval Models Avinash Madasu Vasudev Lal CoGe 42 3 0 28 Jun 2023
Word sense extension Lei Yu Yang Xu 19 4 0 09 Jun 2023
Representation Of Lexical Stylistic Features In Language Models' Embedding Space Qing Lyu Marianna Apidianaki Chris Callison-Burch 33 6 0 29 May 2023
Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss Information Sunjae Kwon Rishabh Garodia Minhwa Lee Zhichao Yang Hong-ye Yu CoGe 39 3 0 02 May 2023
A Survey on Contextualised Semantic Shift Detection S. Montanelli Francesco Periti ObjD AI4TS 29 26 0 04 Apr 2023
Attention is Not Always What You Need: Towards Efficient Classification of Domain-Specific Text Yasmen Wahba N. Madhavji John Steinbacher 30 0 0 31 Mar 2023
Exploring Category Structure with Contextual Language Models and Lexical Semantic Networks Joseph Renner Pascal Denis Rémi Gilleron Angèle Brunellière 16 3 0 14 Feb 2023
Reconstruction Probing Najoung Kim Jatin Khilnani Alex Warstadt Abed Qaddoumi 13 1 0 21 Dec 2022
Measure More, Question More: Experimental Studies on Transformer-based Language Models and Complement Coercion Yuling Gu 22 1 0 20 Dec 2022
Transparency Helps Reveal When Language Models Learn Meaning Zhaofeng Wu William Merrill Hao Peng Iz Beltagy Noah A. Smith 19 9 0 14 Oct 2022
Towards Faithful Model Explanation in NLP: A Survey Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 109 107 0 22 Sep 2022
Lost in Context? On the Sense-wise Variance of Contextualized Word Embeddings Yile Wang Yue Zhang 19 4 0 20 Aug 2022
Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representations Robert Wolfe Aylin Caliskan VLM 21 13 0 14 Mar 2022
Measuring Context-Word Biases in Lexical Semantic Datasets Qianchu Liu Diana McCarthy Anna Korhonen 31 2 0 13 Dec 2021
Patterns of Lexical Ambiguity in Contextualised Language Models J. Haber Massimo Poesio 11 7 0 27 Sep 2021
MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models Qianchu Liu Fangyu Liu Nigel Collier Anna Korhonen Ivan Vulić 139 21 0 19 Sep 2021
All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality William Timkey Marten van Schijndel 213 110 0 09 Sep 2021
LMMS Reloaded: Transformer-based Sense Embeddings for Disambiguation and Beyond Daniel Loureiro A. Jorge Jose Camacho-Collados 33 26 0 26 May 2021
SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection Dominik Schlechtweg Barbara McGillivray Simon Hengchen Haim Dubossarsky Nina Tahmasebi 148 236 0 22 Jul 2020
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 198 181 0 03 Sep 2019
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 201 882 0 03 May 2018
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 245 31,257 0 16 Jan 2013