v1v2v3 (latest)

Linguistic Profiling of a Neural Language Model

5 October 2020

Papers citing "Linguistic Profiling of a Neural Language Model"

27 / 27 papers shown

Title
Linguistic Interpretability of Transformer-based Language Models: a systematic review Miguel López-Otal Jorge Gracia Jordi Bernad Carlos Bobed Lucía Pitarch-Ballesteros Emma Anglés-Herrero VLM 96 1 0 09 Apr 2025
Evaluating Self-Generated Documents for Enhancing Retrieval-Augmented Generation with Large Language Models Jiatao Li Xinyu Hu Xunjian Yin Xiaojun Wan RALM 127 0 0 17 Oct 2024
Designing and Interpreting Probes with Control Tasks John Hewitt Percy Liang 86 538 0 08 Sep 2019
Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIs Alex Warstadt Yuning Cao Ioana Grosu Wei Peng Hagen Blix ... Jason Phang Anhad Mohananey Phu Mon Htut Paloma Jeretic Samuel R. Bowman 67 123 0 05 Sep 2019
Revealing the Dark Secrets of BERT Olga Kovaleva Alexey Romanov Anna Rogers Anna Rumshisky 53 554 0 21 Aug 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 235 1,605 0 11 Jun 2019
Analyzing the Structure of Attention in a Transformer Language Model Jesse Vig Yonatan Belinkov 73 370 0 07 Jun 2019
Open Sesame: Getting Inside BERT's Linguistic Knowledge Yongjie Lin Y. Tan Robert Frank 63 287 0 04 Jun 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 189 865 0 15 May 2019
BERT Rediscovers the Classical NLP Pipeline Ian Tenney Dipanjan Das Ellie Pavlick MILM SSeg 147 1,482 0 15 May 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 137 735 0 21 Mar 2019
Attention is not Explanation Sarthak Jain Byron C. Wallace FAtt 152 1,330 0 26 Feb 2019
Assessing BERT's Syntactic Abilities Yoav Goldberg 75 496 0 16 Jan 2019
Analysis Methods in Neural Language Processing: A Survey Yonatan Belinkov James R. Glass 98 558 0 21 Dec 2018
Understanding Learning Dynamics Of Language Models with SVCCA Naomi Saphra Adam Lopez 102 94 0 01 Nov 2018
An Analysis of Attention Mechanisms: The Case of Word Sense Disambiguation in Neural Machine Translation Gongbo Tang Rico Sennrich Joakim Nivre 68 85 0 17 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,324 0 11 Oct 2018
Targeted Syntactic Evaluation of Language Models Rebecca Marvin Tal Linzen 92 417 0 27 Aug 2018
Evaluation of sentence embeddings in downstream and linguistic probing tasks C. Perone Roberto Silveira Thomas S. Paula ELM 80 155 0 16 Jun 2018
Deep RNNs Encode Soft Hierarchical Syntax Terra Blevins Omer Levy Luke Zettlemoyer 84 111 0 11 May 2018
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 353 896 0 03 May 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 235 11,569 0 15 Feb 2018
Evaluating Layers of Representation in Neural Machine Translation on Part-of-Speech and Semantic Tagging Tasks Yonatan Belinkov Lluís Màrquez i Villodre Hassan Sajjad Nadir Durrani Fahim Dalvi James R. Glass 77 165 0 23 Jan 2018
Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks Yossi Adi Einat Kermany Yonatan Belinkov Ofer Lavi Yoav Goldberg 90 546 0 15 Aug 2016
Representation of linguistic form and function in recurrent neural networks Ákos Kádár Grzegorz Chrupała Afra Alishahi 75 162 0 29 Feb 2016
Visualizing and Understanding Recurrent Networks A. Karpathy Justin Johnson Li Fei-Fei HAI 132 1,102 0 05 Jun 2015
Visualizing and Understanding Neural Models in NLP Jiwei Li Xinlei Chen Eduard H. Hovy Dan Jurafsky MILM FAtt 91 707 0 02 Jun 2015