Picking BERT's Brain: Probing for Linguistic Dependencies in Contextualized Embeddings Using Representational Similarity Analysis

24 November 2020

Papers citing "Picking BERT's Brain: Probing for Linguistic Dependencies in Contextualized Embeddings Using Representational Similarity Analysis"

26 / 26 papers shown

Title
Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding words Josef Klafka Allyson Ettinger 62 43 0 04 May 2020
Similarity Analysis of Contextual Word Representation Models John M. Wu Yonatan Belinkov Hassan Sajjad Nadir Durrani Fahim Dalvi James R. Glass 71 75 0 03 May 2020
Information-Theoretic Probing with Minimum Description Length Elena Voita Ivan Titov 45 272 0 27 Mar 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 62 1,489 0 27 Feb 2020
Do Attention Heads in BERT Track Syntactic Dependencies? Phu Mon Htut Jason Phang Shikha Bordia Samuel R. Bowman 49 137 0 27 Nov 2019
How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings Kawin Ethayarajh 52 858 0 02 Sep 2019
BERT for Coreference Resolution: Baselines and Analysis Mandar Joshi Omer Levy Daniel S. Weld Luke Zettlemoyer 57 321 0 24 Aug 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 186 1,586 0 11 Jun 2019
Visualizing and Measuring the Geometry of BERT Andy Coenen Emily Reif Ann Yuan Been Kim Adam Pearce F. Viégas Martin Wattenberg MILM 61 416 0 06 Jun 2019
Open Sesame: Getting Inside BERT's Linguistic Knowledge Yongjie Lin Y. Tan Robert Frank 34 287 0 04 Jun 2019
Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brains Samira Abnar Lisa Beinborn Rochelle Choenni Willem H. Zuidema 23 76 0 04 Jun 2019
Correlation Coefficients and Semantic Textual Similarity V. Zhelezniak Aleksandar Savkov April Shen Nils Y. Hammerla 44 50 0 19 May 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 159 853 0 15 May 2019
Correlating neural and symbolic representations of language Grzegorz Chrupała Afra Alishahi NAI 25 72 0 14 May 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 97 728 0 21 Mar 2019
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference R. Thomas McCoy Ellie Pavlick Tal Linzen 111 1,226 0 04 Feb 2019
Assessing BERT's Syntactic Abilities Yoav Goldberg 55 494 0 16 Jan 2019
Symbolic inductive bias for visually grounded learning of spoken language Grzegorz Chrupała 44 28 0 21 Dec 2018
Analysis Methods in Neural Language Processing: A Survey Yonatan Belinkov James R. Glass 61 555 0 21 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 951 93,936 0 11 Oct 2018
How agents see things: On visual representations in an emergent language game Diane Bouchacourt Marco Baroni 61 95 0 31 Aug 2018
Colorless green recurrent networks dream hierarchically Kristina Gulordava Piotr Bojanowski Edouard Grave Tal Linzen Marco Baroni 69 504 0 29 Mar 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 109 11,520 0 15 Feb 2018
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies Tal Linzen Emmanuel Dupoux Yoav Goldberg 75 901 0 04 Nov 2016
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 224 4,268 0 21 Aug 2015
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 296 33,445 0 16 Oct 2013