Probing Pretrained Language Models for Lexical Semantics

12 October 2020

Papers citing "Probing Pretrained Language Models for Lexical Semantics"

50 / 129 papers shown

Title
Representation Of Lexical Stylistic Features In Language Models' Embedding Space Qing Lyu Marianna Apidianaki Chris Callison-Burch 36 6 0 29 May 2023
Syntax and Semantics Meet in the "Middle": Probing the Syntax-Semantics Interface of LMs Through Agentivity Lindia Tjuatja Emmy Liu Lori S. Levin Graham Neubig 35 2 0 29 May 2023
Vec2Gloss: definition modeling leveraging contextualized vectors with Wordnet gloss Yu-Hsiang Tseng Mao-Chang Ku Wei-Ling Chen Yu-Lin Chang S. Hsieh 11 2 0 29 May 2023
Latent Positional Information is in the Self-Attention Variance of Transformer Language Models Without Positional Embeddings Ta-Chung Chi Ting-Han Fan Li-Wei Chen Alexander I. Rudnicky Peter J. Ramadge VLM MILM 52 12 0 23 May 2023
Distilling Semantic Concept Embeddings from Contrastively Fine-Tuned Language Models Na Li Hanane Kteich Zied Bouraoui Steven Schockaert 30 9 0 16 May 2023
StrAE: Autoencoding for Pre-Trained Embeddings using Explicit Structure Mattia Opper Victor Prokhorov N. Siddharth BDL 24 2 0 09 May 2023
Exploring Linguistic Properties of Monolingual BERTs with Typological Classification among Languages Elena Sofia Ruzzetti Federico Ranaldi F. Logozzo Michele Mastromattei Leonardo Ranaldi Fabio Massimo Zanzotto 19 8 0 03 May 2023
Revealing Weaknesses of Vietnamese Language Models Through Unanswerable Questions in Machine Reading Comprehension Son Quoc Tran Phong Nguyen-Thuan Do Kiet Van Nguyen Ngan Luu-Thuy Nguyen 39 0 0 16 Mar 2023
Do Transformers Parse while Predicting the Masked Word? Haoyu Zhao A. Panigrahi Rong Ge Sanjeev Arora 76 31 0 14 Mar 2023
Competence-Based Analysis of Language Models Adam Davies Jize Jiang Chengxiang Zhai ELM 29 4 0 01 Mar 2023
Does Deep Learning Learn to Abstract? A Systematic Probing Framework Shengnan An Zeqi Lin B. Chen Qiang Fu Nanning Zheng Jian-Guang Lou 36 4 0 23 Feb 2023
A Psycholinguistic Analysis of BERT's Representations of Compounds Lars Buijtelaar Sandro Pezzelle 20 8 0 14 Feb 2023
Attending to Graph Transformers Luis Muller Mikhail Galkin Christopher Morris Ladislav Rampášek 49 86 0 08 Feb 2023
COMBO: A Complete Benchmark for Open KG Canonicalization Chengyue Jiang Yong-jia Jiang Weiqi Wu Yuting Zheng Pengjun Xie Kewei Tu 34 2 0 08 Feb 2023
Protein Representation Learning via Knowledge Enhanced Primary Structure Modeling Hong-Yu Zhou Yunxiang Fu Zhicheng Zhang Cheng Bian Yizhou Yu 22 8 0 30 Jan 2023
AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning Han Zhou Xingchen Wan Ivan Vulić Anna Korhonen 21 45 0 28 Jan 2023
Topological Data Analysis for Speech Processing Eduard Tulchinskii Kristian Kuznetsov Laida Kushnareva D. Cherniavskii S. Barannikov Irina Piontkovskaya Sergey I. Nikolenko Evgeny Burnaev 35 5 0 30 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 24 121 0 11 Nov 2022
SocioProbe: What, When, and Where Language Models Learn about Sociodemographics Anne Lauscher Federico Bianchi Samuel R. Bowman Dirk Hovy 29 7 0 08 Nov 2022
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models Hao Peng Xiaozhi Wang Shengding Hu Hailong Jin Lei Hou Juanzi Li Zhiyuan Liu Qun Liu 18 22 0 08 Nov 2022
Do Charge Prediction Models Learn Legal Theory? Zhenwei An Quzhe Huang Cong Jiang Yansong Feng Dongyan Zhao ELM AILaw 27 6 0 31 Oct 2022
Improving Bilingual Lexicon Induction with Cross-Encoder Reranking Yaoyiran Li Fangyu Liu Ivan Vulić Anna Korhonen 34 10 0 30 Oct 2022
The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative Leonie Weissweiler Valentin Hofmann Abdullatif Köksal Hinrich Schütze 32 32 0 24 Oct 2022
Understanding Domain Learning in Language Models Through Subpopulation Analysis Zheng Zhao Yftah Ziser Shay B. Cohen 34 6 0 22 Oct 2022
What do Large Language Models Learn beyond Language? Avinash Madasu Shashank Srivastava LRM AI4CE 44 5 0 21 Oct 2022
Transparency Helps Reveal When Language Models Learn Meaning Zhaofeng Wu William Merrill Hao Peng Iz Beltagy Noah A. Smith 19 9 0 14 Oct 2022
Massively Multilingual Lexical Specialization of Multilingual Transformers Tommaso Green Simone Paolo Ponzetto Goran Glavavs 24 0 0 01 Aug 2022
Understanding Robust Learning through the Lens of Representation Similarities Christian Cianfarani A. Bhagoji Vikash Sehwag Ben Y. Zhao Prateek Mittal Haitao Zheng OOD 21 16 0 20 Jun 2022
How to Dissect a Muppet: The Structure of Transformer Embedding Spaces Timothee Mickus Denis Paperno Mathieu Constant 21 19 0 07 Jun 2022
Improving Contextual Representation with Gloss Regularized Pre-training Yu Lin Zhecheng An Peihao Wu Zejun Ma 19 5 0 13 May 2022
Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models Karolina Stañczak E. Ponti Lucas Torroba Hennigen Ryan Cotterell Isabelle Augenstein MILM LRM 27 10 0 04 May 2022
Probing Cross-Lingual Lexical Knowledge from Multilingual Sentence Encoders Ivan Vulić Goran Glavavs Fangyu Liu Nigel Collier E. Ponti Anna Korhonen 28 8 0 30 Apr 2022
GAP: A Graph-aware Language Model Framework for Knowledge Graph-to-Text Generation Anthony Colas Mehrdad Alvandipour D. Wang 25 23 0 13 Apr 2022
Probing Pre-Trained Language Models for Cross-Cultural Differences in Values Arnav Arora Lucie-Aimée Kaffee Isabelle Augenstein VLM 31 123 0 25 Mar 2022
Geographic Adaptation of Pretrained Language Models Valentin Hofmann Goran Glavavs Nikola Ljubevsić J. Pierrehumbert Hinrich Schütze VLM 21 16 0 16 Mar 2022
Improving Word Translation via Two-Stage Contrastive Learning Yaoyiran Li Fangyu Liu Nigel Collier Anna Korhonen Ivan Vulić 39 29 0 15 Mar 2022
On the data requirements of probing Zining Zhu Jixuan Wang Bai Li Frank Rudzicz 19 5 0 25 Feb 2022
Assessing the State of Self-Supervised Human Activity Recognition using Wearables H. Haresamudram Irfan Essa Thomas Plötz SSL 42 86 0 22 Feb 2022
A Latent-Variable Model for Intrinsic Probing Karolina Stañczak Lucas Torroba Hennigen Adina Williams Ryan Cotterell Isabelle Augenstein 21 4 0 20 Jan 2022
Do Multi-Lingual Pre-trained Language Models Reveal Consistent Token Attributions in Different Languages? Junxiang Wang Xuchao Zhang Bo Zong Yanchi Liu Wei Cheng Jingchao Ni Haifeng Chen Liang Zhao AAML 32 0 0 23 Dec 2021
On Cross-Lingual Retrieval with Multilingual Text Encoders Robert Litschko Ivan Vulić Simone Paolo Ponzetto Goran Glavavs 19 38 0 21 Dec 2021
Decomposing Natural Logic Inferences in Neural NLI Julia Rozanova Deborah Ferreira Marco Valentino Mokanrarangan Thayaparan André Freitas NAI LRM 12 4 0 15 Dec 2021
Measuring Context-Word Biases in Lexical Semantic Datasets Qianchu Liu Diana McCarthy Anna Korhonen 31 2 0 13 Dec 2021
Using Distributional Principles for the Semantic Study of Contextual Language Models Olivier Ferret 22 1 0 23 Nov 2021
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 29 45 0 16 Oct 2021
Prix-LM: Pretraining for Multilingual Knowledge Base Construction Wenxuan Zhou Fangyu Liu Ivan Vulić Nigel Collier Muhao Chen KELM 72 18 0 16 Oct 2021
Pre-trained Language Models in Biomedical Domain: A Systematic Survey Benyou Wang Qianqian Xie Jiahuan Pei Zhihong Chen Prayag Tiwari Zhao Li Jie Fu LM&MA AI4CE 37 163 0 11 Oct 2021
Does Vision-and-Language Pretraining Improve Lexical Grounding? Tian Yun Chen Sun Ellie Pavlick VLM CoGe 40 30 0 21 Sep 2021
Distilling Relation Embeddings from Pre-trained Language Models Asahi Ushio Jose Camacho-Collados Steven Schockaert 19 21 0 21 Sep 2021
ConvFiT: Conversational Fine-Tuning of Pretrained Language Models Ivan Vulić Pei-hao Su Sam Coope D. Gerz Paweł Budzianowski I. Casanueva Nikola Mrkvsić Tsung-Hsien Wen 24 36 0 21 Sep 2021