Linguistic Knowledge and Transferability of Contextual Representations

21 March 2019

Papers citing "Linguistic Knowledge and Transferability of Contextual Representations"

50 / 454 papers shown

Title
LiFi: Lightweight Controlled Text Generation with Fine-Grained Control Codes Chufan Shi Deng Cai Yujiu Yang 36 3 0 10 Feb 2024
Textual Entailment for Effective Triple Validation in Object Prediction Andrés García-Silva Cristian Berrío José Manuél Gómez-Pérez KELM 19 1 0 29 Jan 2024
Semantic Sensitivities and Inconsistent Predictions: Measuring the Fragility of NLI Models Erik Arakelyan Zhaoqi Liu Isabelle Augenstein AAML 45 9 0 25 Jan 2024
HiGen: Hierarchy-Aware Sequence Generation for Hierarchical Text Classification Vidit Jain Mukund Rungta Yuchen Zhuang Yue Yu Zeyu Wang Mu Gao Jeffrey Skolnick Chao Zhang 19 0 0 24 Jan 2024
How Proficient Are Large Language Models in Formal Languages? An In-Depth Insight for Knowledge Base Question Answering Jinxi Liu S. Cao Jiaxin Shi Tingjian Zhang Lunyiu Nie Linmei Hu Lei Hou Juanzi Li ELM 27 3 0 11 Jan 2024
MLPs Compass: What is learned when MLPs are combined with PLMs? Li Zhou Wenyu Chen Yong Cao DingYi Zeng Wanlong Liu Hong Qu 34 0 0 03 Jan 2024
A Comprehensive Study of Knowledge Editing for Large Language Models Ningyu Zhang Yunzhi Yao Bo Tian Peng Wang Shumin Deng ... Lei Liang Zhiqiang Zhang Xiao-Jun Zhu Jun Zhou Huajun Chen KELM 41 76 0 02 Jan 2024
Deep de Finetti: Recovering Topic Distributions from Large Language Models Liyi Zhang R. Thomas McCoy T. Sumers Jian-Qiao Zhu Thomas L. Griffiths BDL 49 6 0 21 Dec 2023
Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers Nuo Chen Ning Wu Shining Liang Ming Gong Linjun Shou Dongmei Zhang Jia Li LRM 19 9 0 07 Dec 2023
Towards Measuring Representational Similarity of Large Language Models Max Klabunde Mehdi Ben Amor Michael Granitzer Florian Lemmerich 39 1 0 05 Dec 2023
Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars Kaiyue Wen Yuchen Li Bing Liu Andrej Risteski 21 21 0 03 Dec 2023
The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP Julian Michael 11 1 0 01 Dec 2023
Injecting linguistic knowledge into BERT for Dialogue State Tracking Xiaohan Feng Xixin Wu Helen M. Meng 19 0 0 27 Nov 2023
Physical Reasoning and Object Planning for Household Embodied Agents Ayush Agrawal Raghav Prabhakar Anirudh Goyal Dianbo Liu LM&Ro LRM 13 0 0 22 Nov 2023
An Eye on Clinical BERT: Investigating Language Model Generalization for Diabetic Eye Disease Phenotyping Keith Harrigian Tina Tang Anthony Gonzales Cindy X. Cai Mark Dredze VLM 33 2 0 15 Nov 2023
Finding and Editing Multi-Modal Neurons in Pre-Trained Transformers Haowen Pan Yixin Cao Xiaozhi Wang Xun Yang Meng Wang KELM 41 24 0 13 Nov 2023
Perturbed examples reveal invariances shared by language models Ruchit Rawal Mariya Toneva AAML 34 0 0 07 Nov 2023
Increasing The Performance of Cognitively Inspired Data-Efficient Language Models via Implicit Structure Building Omar Momen David Arps Laura Kallmeyer AI4CE 27 2 0 31 Oct 2023
Probing LLMs for Joint Encoding of Linguistic Categories Giulio Starace Konstantinos Papakostas Rochelle Choenni Apostolos Panagiotopoulos Matteo Rosati Alina Leidinger Ekaterina Shutova 23 5 0 28 Oct 2023
Understanding the Role of Input Token Characters in Language Models: How Does Information Loss Affect Performance? Ahmed Alajrami Katerina Margatina Nikolaos Aletras AAML 19 1 0 26 Oct 2023
The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining Ting-Rui Chiang Dani Yogatama 25 1 0 25 Oct 2023
Is Probing All You Need? Indicator Tasks as an Alternative to Probing Embedding Spaces Tal Levy Omer Goldman Reut Tsarfaty 11 3 0 24 Oct 2023
Improving Language Models Meaning Understanding and Consistency by Learning Conceptual Roles from Dictionary Myeongjun Jang Thomas Lukasiewicz 22 4 0 24 Oct 2023
Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject Number Sophie Hao Tal Linzen 16 5 0 23 Oct 2023
Understanding the Inner Workings of Language Models Through Representation Dissimilarity Davis Brown Charles Godfrey N. Konz Jonathan Tu Henry Kvinge 37 7 0 23 Oct 2023
Implications of Annotation Artifacts in Edge Probing Test Datasets Sagnik Ray Choudhury Jushaan Kalra 16 0 0 20 Oct 2023
Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization Ningyu Xu Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 38 4 0 19 Oct 2023
Rethinking the Construction of Effective Metrics for Understanding the Mechanisms of Pretrained Language Models You Li Jinhui Yin Yuming Lin 29 0 0 19 Oct 2023
Investigating semantic subspaces of Transformer sentence embeddings through linear structural probing Dmitry Nikolaev Sebastian Padó 46 5 0 18 Oct 2023
Disentangling the Linguistic Competence of Privacy-Preserving BERT Stefan Arnold Nils Kemmerzell Annika Schreiner 25 0 0 17 Oct 2023
The Temporal Structure of Language Processing in the Human Brain Corresponds to The Layered Hierarchy of Deep Language Models Ariel Goldstein Eric Ham Mariano Schain Samuel A. Nastase Zaid Zada ... Avinatan Hassidim O. Devinsky A. Flinker Omer Levy Uri Hasson AI4CE 15 10 0 11 Oct 2023
Recurrent Neural Language Models as Probabilistic Finite-state Automata Anej Svete Ryan Cotterell 32 2 0 08 Oct 2023
Discovering Knowledge-Critical Subnetworks in Pretrained Language Models Deniz Bayazit Negar Foroutan Zeming Chen Gail Weiss Antoine Bosselut KELM 24 13 0 04 Oct 2023
Assessment of Pre-Trained Models Across Languages and Grammars Alberto Muñoz-Ortiz David Vilares Carlos Gómez-Rodríguez 19 2 0 20 Sep 2023
Neurons in Large Language Models: Dead, N-gram, Positional Elena Voita Javier Ferrando Christoforos Nalmpantis MILM 27 45 0 09 Sep 2023
Construction Grammar and Language Models Harish Tayyar Madabushi Laurence Romain P. Milin Dagmar Divjak 21 5 0 25 Aug 2023
Scaling up Discovery of Latent Concepts in Deep NLP Models Majd Hawasly Fahim Dalvi Nadir Durrani 31 4 0 20 Aug 2023
Multimodality and Attention Increase Alignment in Natural Language Prediction Between Humans and Computational Models V. Kewenig Andrew Lampinen Samuel A. Nastase Christopher Edwards Quitterie Lacome DEstalenx Akilles Rechardt Jeremy I. Skipper G. Vigliocco 22 3 0 11 Aug 2023
Intelligent Assistant Language Understanding On Device Cecilia Aas Hisham Abdelsalam Irina Belousova Shruti Bhargava Jianpeng Cheng ... John Torr Marco Del Vecchio Jay Wacker Jason D. Williams Hong-ye Yu 19 2 0 07 Aug 2023
Why Linguistics Will Thrive in the 21st Century: A Reply to Piantadosi (2023) Jordan Kodner Sarah Payne Jeffrey Heinz LRM 14 11 0 06 Aug 2023
Towards Explainable Evaluation Metrics for Machine Translation Christoph Leiter Piyawat Lertvittayakumjorn M. Fomicheva Wei-Ye Zhao Yang Gao Steffen Eger ELM 28 13 0 22 Jun 2023
Operationalising Representation in Natural Language Processing J. Harding 28 11 0 14 Jun 2023
PauseSpeech: Natural Speech Synthesis via Pre-trained Language Model and Pause-based Prosody Modeling Ji-Sang Hwang Sang-Hoon Lee Seong-Whan Lee 16 4 0 13 Jun 2023
Morphosyntactic probing of multilingual BERT models Judit Ács Endre Hamerlik Roy Schwartz Noah A. Smith András Kornai 29 9 0 09 Jun 2023
ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning Xiao Xu Bei Li Chenfei Wu Shao-Yen Tseng Anahita Bhiwandiwalla Shachar Rosenman Vasudev Lal Wanxiang Che Nan Duan AIFin VLM 29 2 0 31 May 2023
How Does Pretraining Improve Discourse-Aware Translation? Zhihong Huang Longyue Wang Siyou Liu Derek F. Wong 21 1 0 31 May 2023
Empirical Sufficiency Lower Bounds for Language Modeling with Locally-Bootstrapped Semantic Structures Jakob Prange Emmanuele Chersoni 32 0 0 30 May 2023
Emergent Modularity in Pre-trained Transformers Zhengyan Zhang Zhiyuan Zeng Yankai Lin Chaojun Xiao Xiaozhi Wang Xu Han Zhiyuan Liu Ruobing Xie Maosong Sun Jie Zhou MoE 37 23 0 28 May 2023
Diagnosing Transformers: Illuminating Feature Spaces for Clinical Decision-Making Aliyah R. Hsu Yeshwanth Cherapanamjeri Briton Park Tristan Naumann A. Odisho Bin-Xia Yu MedIm 21 0 0 27 May 2023
CIF-PT: Bridging Speech and Text Representations for Spoken Language Understanding via Continuous Integrate-and-Fire Pre-Training Linhao Dong Zhecheng An Peihao Wu Jun Zhang Lu Lu Zejun Ma 17 6 0 27 May 2023