A Systematic Assessment of Syntactic Generalization in Neural Language Models

7 May 2020

Papers citing "A Systematic Assessment of Syntactic Generalization in Neural Language Models"

26 / 126 papers shown

Title
Effective Batching for Recurrent Neural Network Grammars Hiroshi Noji Yohei Oseki GNN 18 16 0 31 May 2021
Language Models Use Monotonicity to Assess NPI Licensing Jaap Jumelet Milica Denić Jakub Szymanik Dieuwke Hupkes Shane Steinert-Threlkeld KELM 21 28 0 28 May 2021
How is BERT surprised? Layerwise detection of linguistic anomalies Bai Li Zining Zhu Guillaume Thomas Yang Xu Frank Rudzicz 27 31 0 16 May 2021
Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models Laura Pérez-Mayos Alba Táboas García Simon Mille Leo Wanner ELM LRM 18 8 0 10 May 2021
Is Incoherence Surprising? Targeted Evaluation of Coherence Prediction from Language Models Anne Beyer Sharid Loáiciga David Schlangen 27 15 0 07 May 2021
Improving BERT Pretraining with Syntactic Supervision Georgios Tziafas Konstantinos Kogkalidis G. Wijnholds M. Moortgat 35 3 0 21 Apr 2021
Refining Targeted Syntactic Evaluation of Language Models Benjamin Newman Kai-Siang Ang Julia Gong John Hewitt 29 43 0 19 Apr 2021
Vyākarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages Rajaswa Patil Jasleen Dhillon Siddhant Mahurkar Saumitra Kulkarni M. Malhotra V. Baths 17 1 0 01 Mar 2021
Enhancing the Transformer Decoder with Transition-based Syntax Leshem Choshen Omri Abend 33 1 0 29 Jan 2021
CLiMP: A Benchmark for Chinese Language Model Evaluation Beilei Xiang Changbing Yang Yu Li Alex Warstadt Katharina Kann ALM 19 38 0 26 Jan 2021
Disentangling semantics in language through VAEs and a certain architectural choice G. Felhi Joseph Le Roux Djamé Seddah CoGe DRL 14 1 0 24 Dec 2020
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling Yikang Shen Yi Tay Che Zheng Dara Bahri Donald Metzler Aaron Courville 6 41 0 01 Dec 2020
When Do You Need Billions of Words of Pretraining Data? Yian Zhang Alex Warstadt Haau-Sing Li Samuel R. Bowman 26 136 0 10 Nov 2020
A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English Marius Mosbach Stefania Degaetano-Ortlieb Marie-Pauline Krielke Badr M. Abdullah Dietrich Klakow 22 6 0 02 Nov 2020
Explicitly Modeling Syntax in Language Models with Incremental Parsing and a Dynamic Oracle Yikang Shen Shawn Tan Alessandro Sordoni Siva Reddy Aaron C. Courville 19 5 0 21 Oct 2020
Structural Supervision Improves Few-Shot Learning and Syntactic Generalization in Neural Language Models Ethan Gotlieb Wilcox Peng Qian Richard Futrell Ryosuke Kohita R. Levy Miguel Ballesteros NAI 15 10 0 12 Oct 2020
Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually) Alex Warstadt Yian Zhang Haau-Sing Li Haokun Liu Samuel R. Bowman SSL AI4CE 37 21 0 11 Oct 2020
Discourse structure interacts with reference but not syntax in neural language models Forrest Davis Marten van Schijndel 6 20 0 10 Oct 2020
Learning Context-Free Languages with Nondeterministic Stack RNNs Brian DuSell David Chiang 13 13 0 09 Oct 2020
Recurrent babbling: evaluating the acquisition of grammar from limited input data Ludovica Pannitto Aurélie Herbelot 12 13 0 09 Oct 2020
Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modeling Sophie Hao S. Mendelsohn Rachel Sterneck Randi Martinez Robert Frank 11 46 0 08 Sep 2020
Discovering Useful Sentence Representations from Large Pretrained Language Models Nishant Subramani Nivedita Suresh 6 5 0 20 Aug 2020
On the Predictive Power of Neural Language Models for Human Real-Time Comprehension Behavior Ethan Gotlieb Wilcox Jon Gauthier Jennifer Hu Peng Qian R. Levy 9 158 0 02 Jun 2020
Syntactic Structure Distillation Pretraining For Bidirectional Encoders A. Kuncoro Lingpeng Kong Daniel Fried Dani Yogatama Laura Rimell Chris Dyer Phil Blunsom 31 33 0 27 May 2020
Discovering the Compositional Structure of Vector Representations with Role Learning Networks Paul Soulos R. Thomas McCoy Tal Linzen P. Smolensky CoGe 29 43 0 21 Oct 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,959 0 20 Apr 2018