What do you learn from context? Probing for sentence structure in contextualized word representations

15 May 2019

Berlin Chen

Papers citing "What do you learn from context? Probing for sentence structure in contextualized word representations"

50 / 532 papers shown

Title
Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization Ningyu Xu Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 41 4 0 19 Oct 2023
Grounded and Well-rounded: A Methodological Approach to the Study of Cross-modal and Cross-lingual Grounding Timothee Mickus Elaine Zosa Denis Paperno 42 0 0 18 Oct 2023
Disentangling the Linguistic Competence of Privacy-Preserving BERT Stefan Arnold Nils Kemmerzell Annika Schreiner 30 0 0 17 Oct 2023
Assessment of Pre-Trained Models Across Languages and Grammars Alberto Muñoz-Ortiz David Vilares Carlos Gómez-Rodríguez 24 2 0 20 Sep 2023
Leveraging Contextual Information for Effective Entity Salience Detection Rajarshi Bhowmik Marco Ponza Atharva Tendle Anant Gupta Rebecca Jiang Xingyu Lu Qian Zhao Daniel Preotiuc-Pietro 13 1 0 14 Sep 2023
Semantic reconstruction of continuous language from MEG signals Bo Wang Xiran Xu Longxiang Zhang Boda Xiao Xihong Wu J. Chen 23 2 0 14 Sep 2023
Are Emergent Abilities in Large Language Models just In-Context Learning? Sheng Lu Irina Bigoulaeva Rachneet Sachdeva Harish Tayyar Madabushi Iryna Gurevych LRM ELM ReLM 49 93 0 04 Sep 2023
Explainability for Large Language Models: A Survey Haiyan Zhao Hanjie Chen Fan Yang Ninghao Liu Huiqi Deng Hengyi Cai Shuaiqiang Wang Dawei Yin Jundong Li LRM 29 411 0 02 Sep 2023
Construction Grammar and Language Models Harish Tayyar Madabushi Laurence Romain P. Milin Dagmar Divjak 26 5 0 25 Aug 2023
Why Linguistics Will Thrive in the 21st Century: A Reply to Piantadosi (2023) Jordan Kodner Sarah Payne Jeffrey Heinz LRM 14 11 0 06 Aug 2023
Agentività e telicità in GilBERTo: implicazioni cognitive A. Lombardi Alessandro Lenci 23 1 0 06 Jul 2023
Concept-Based Explanations to Test for False Causal Relationships Learned by Abusive Language Classifiers I. Nejadgholi S. Kiritchenko Kathleen C. Fraser Esma Balkir 26 0 0 04 Jul 2023
Comparing the Efficacy of Fine-Tuning and Meta-Learning for Few-Shot Policy Imitation Massimiliano Patacchiola Mingfei Sun Katja Hofmann Richard Turner OffRL 26 1 0 23 Jun 2023
Towards Explainable Evaluation Metrics for Machine Translation Christoph Leiter Piyawat Lertvittayakumjorn M. Fomicheva Wei-Ye Zhao Yang Gao Steffen Eger ELM 28 13 0 22 Jun 2023
Limits for Learning with Language Models Nicholas M. Asher Swarnadeep Bhar Akshay Chaturvedi Julie Hunter Soumya Paul 19 22 0 21 Jun 2023
Towards Understanding What Code Language Models Learned Toufique Ahmed Dian Yu Chen Huang Cathy Wang Prem Devanbu Kenji Sagae ELM 40 5 0 20 Jun 2023
Operationalising Representation in Natural Language Processing J. Harding 28 11 0 14 Jun 2023
Morphosyntactic probing of multilingual BERT models Judit Ács Endre Hamerlik Roy Schwartz Noah A. Smith András Kornai 32 9 0 09 Jun 2023
Table and Image Generation for Investigating Knowledge of Entities in Pre-trained Vision and Language Models Hidetaka Kamigaito Katsuhiko Hayashi Taro Watanabe VLM 15 1 0 03 Jun 2023
Analyzing Text Representations by Measuring Task Alignment César González-Gutiérrez Audi Primadhanty Francesco Cazzaro A. Quattoni 15 1 0 31 May 2023
Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models Guande He Jianfei Chen Jun Zhu 42 20 0 30 May 2023
Empirical Sufficiency Lower Bounds for Language Modeling with Locally-Bootstrapped Semantic Structures Jakob Prange Emmanuele Chersoni 32 0 0 30 May 2023
Diagnosing Transformers: Illuminating Feature Spaces for Clinical Decision-Making Aliyah R. Hsu Yeshwanth Cherapanamjeri Briton Park Tristan Naumann A. Odisho Bin-Xia Yu MedIm 26 0 0 27 May 2023
Characterizing and Measuring Linguistic Dataset Drift Tyler A. Chang Kishaloy Halder Neha Ann John Yogarshi Vyas Yassine Benajiba Miguel Ballesteros Dan Roth 13 2 0 26 May 2023
Structural Ambiguity and its Disambiguation in Language Model Based Parsers: the Case of Dutch Clause Relativization G. Wijnholds M. Moortgat 24 3 0 24 May 2023
Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language Models Amirhossein Kazemnejad Mehdi Rezagholizadeh Prasanna Parthasarathi Sarath Chandar ELM 27 2 0 24 May 2023
On Robustness of Finetuned Transformer-based NLP Models Pavan Kalyan Reddy Neerudu S. Oota Mounika Marreddy Venkateswara Rao Kagita Manish Gupta 29 7 0 23 May 2023
Can Language Models Understand Physical Concepts? Lei Li Jingjing Xu Qingxiu Dong Ce Zheng Qi Liu Lingpeng Kong Xu Sun ALM 30 18 0 23 May 2023
Distilling Semantic Concept Embeddings from Contrastively Fine-Tuned Language Models Na Li Hanane Kteich Zied Bouraoui Steven Schockaert 30 9 0 16 May 2023
Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models Boxi Cao Qiaoyu Tang Hongyu Lin Shanshan Jiang Bin Dong Xianpei Han Jiawei Chen Tianshu Wang Le Sun CLL KELM 11 17 0 16 May 2023
Investigating Forgetting in Pre-Trained Representations Through Continual Learning Yun Luo Zhen Yang Xuefeng Bai Fandong Meng Jie Zhou Yue Zhang CLL KELM 24 16 0 10 May 2023
Finding Neurons in a Haystack: Case Studies with Sparse Probing Wes Gurnee Neel Nanda Matthew Pauly Katherine Harvey Dmitrii Troitskii Dimitris Bertsimas MILM 160 188 0 02 May 2023
What does BERT learn about prosody? Sofoklis Kakouros Johannah O'Mahony MILM 17 4 0 25 Apr 2023
LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model Hao Fei Shengqiong Wu Jingye Li Bobo Li Fei Li Libo Qin Meishan Zhang M. Zhang Tat-Seng Chua 26 76 0 13 Apr 2023
Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond Ensheng Shi Yanlin Wang Hongyu Zhang Lun Du Shi Han Dongmei Zhang Hongbin Sun 33 42 0 11 Apr 2023
Scaling Pre-trained Language Models to Deeper via Parameter-efficient Architecture Peiyu Liu Ze-Feng Gao Yushuo Chen Wayne Xin Zhao Ji-Rong Wen MoE 32 0 0 27 Mar 2023
Analyzing the Generalizability of Deep Contextualized Language Representations For Text Classification Berfu Buyukoz 28 2 0 22 Mar 2023
Trained on 100 million words and still in shape: BERT meets British National Corpus David Samuel Andrey Kutuzov Lilja Øvrelid Erik Velldal 24 27 0 17 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 33 27 0 14 Mar 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 25 42 0 10 Mar 2023
Can BERT Refrain from Forgetting on Sequential Tasks? A Probing Study Mingxu Tao Yansong Feng Dongyan Zhao CLL KELM 32 10 0 02 Mar 2023
Targeted Adversarial Attacks against Neural Machine Translation Sahar Sadrizadeh AmirHossein Dabiri Aghdam Ljiljana Dolamic P. Frossard AAML 16 12 0 02 Mar 2023
Understanding Natural Language Understanding Systems. A Critical Analysis Alessandro Lenci ELM 34 12 0 01 Mar 2023
Does Deep Learning Learn to Abstract? A Systematic Probing Framework Shengnan An Zeqi Lin B. Chen Qiang Fu Nanning Zheng Jian-Guang Lou 36 4 0 23 Feb 2023
Language-Specific Representation of Emotion-Concept Knowledge Causally Supports Emotion Inference Ming Li Yusheng Su Hsiu-Yuan Huang Jiali Cheng Xin Hu ... Yujia Qin Xiaozhi Wang Kristen A. Lindquist Zhi-Yun Liu Dan Zhang 32 5 0 19 Feb 2023
False perspectives on human language: why statistics needs linguistics Matteo Greco Andrea Cometa F. Artoni Robert Frank A. Moro 6 5 0 17 Feb 2023
Trust, but Verify: Using Self-Supervised Probing to Improve Trustworthiness Ailin Deng Shen Li Miao Xiong Zhirui Chen Bryan Hooi 16 4 0 06 Feb 2023
Representation Deficiency in Masked Language Modeling Yu Meng Jitin Krishnan Sinong Wang Qifan Wang Yuning Mao Han Fang Marjan Ghazvininejad Jiawei Han Luke Zettlemoyer 87 7 0 04 Feb 2023
TransFool: An Adversarial Attack against Neural Machine Translation Models Sahar Sadrizadeh Ljiljana Dolamic P. Frossard SILM AAML 39 12 0 02 Feb 2023
Do Multi-Document Summarization Models Synthesize? Jay DeYoung Stephanie C. Martinez Iain J. Marshall Byron C. Wallace 22 8 0 31 Jan 2023