Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing

4 June 2021

Papers citing "Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing"

21 / 21 papers shown

Title
Linguistic Interpretability of Transformer-based Language Models: a systematic review Miguel López-Otal Jorge Gracia Jordi Bernad Carlos Bobed Lucía Pitarch-Ballesteros Emma Anglés-Herrero VLM 86 1 0 09 Apr 2025
Physics of Language Models: Part 1, Learning Hierarchical Language Structures Zeyuan Allen-Zhu Yuanzhi Li 88 20 0 23 May 2023
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis Hao Tian Can Gao Xinyan Xiao Hao Liu Bolei He Hua Wu Haifeng Wang Feng Wu 55 232 0 12 May 2020
A Tale of a Probe and a Parser Rowan Hall Maudslay Josef Valvoda Tiago Pimentel Adina Williams Ryan Cotterell 41 55 0 04 May 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 80 1,496 0 27 Feb 2020
Discovering the Compositional Structure of Vector Representations with Role Learning Networks Paul Soulos R. Thomas McCoy Tal Linzen P. Smolensky CoGe 71 43 0 21 Oct 2019
Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIs Alex Warstadt Yuning Cao Ioana Grosu Wei Peng Hagen Blix ... Jason Phang Anhad Mohananey Phu Mon Htut Paloma Jeretic Samuel R. Bowman 46 123 0 05 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 518 24,351 0 26 Jul 2019
Probing Neural Network Comprehension of Natural Language Arguments Timothy Niven Hung-Yu kao AAML 82 454 0 17 Jul 2019
Head-Driven Phrase Structure Grammar Parsing on Penn Treebank Junru Zhou Zhao Hai 66 144 0 05 Jul 2019
Assessing BERT's Syntactic Abilities Yoav Goldberg 71 495 0 16 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.5K 94,511 0 11 Oct 2018
Targeted Syntactic Evaluation of Language Models Rebecca Marvin Tal Linzen 70 415 0 27 Aug 2018
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 311 892 0 03 May 2018
Colorless green recurrent networks dream hierarchically Kristina Gulordava Piotr Bojanowski Edouard Grave Tal Linzen Marco Baroni 78 504 0 29 Mar 2018
Visualisation and 'diagnostic classifiers' reveal how recurrent and recursive neural networks process hierarchical structure Dieuwke Hupkes Sara Veldhoen Willem H. Zuidema 67 277 0 28 Nov 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 628 130,942 0 12 Jun 2017
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies Tal Linzen Emmanuel Dupoux Yoav Goldberg 99 903 0 04 Nov 2016
Understanding intermediate layers using linear classifier probes Guillaume Alain Yoshua Bengio FAtt 127 941 0 05 Oct 2016
Enriching Word Vectors with Subword Information Piotr Bojanowski Edouard Grave Armand Joulin Tomas Mikolov NAI SSL VLM 209 9,957 0 15 Jul 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.4K 149,842 0 22 Dec 2014