Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies

4 November 2016

Papers citing "Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies"

50 / 496 papers shown

Title
What Artificial Neural Networks Can Tell Us About Human Language Acquisition Alex Warstadt Samuel R. Bowman 27 111 0 17 Aug 2022
Assessing the Unitary RNN as an End-to-End Compositional Model of Syntax Jean-Philippe Bernardy Shalom Lappin 57 1 0 11 Aug 2022
Pre-training General Trajectory Embeddings with Maximum Multi-view Entropy Coding Yan Lin Huaiyu Wan Shengnan Guo Jilin Hu Christian S. Jensen Youfang Lin AI4TS 45 19 0 29 Jul 2022
Linguistically inspired roadmap for building biologically reliable protein language models Mai Ha Vu Rahmad Akbar Philippe A. Robert B. Swiatczak Victor Greiff G. K. Sandve Dag Trygve Tryslew Haug 52 35 0 03 Jul 2022
Analyzing Encoded Concepts in Transformer Language Models Hassan Sajjad Nadir Durrani Fahim Dalvi Firoj Alam A. Khan Jia Xu 22 42 0 27 Jun 2022
Discovering Salient Neurons in Deep NLP Models Nadir Durrani Fahim Dalvi Hassan Sajjad KELM MILM 16 15 0 27 Jun 2022
Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold Sebastian Ruder Ivan Vulić Anders Søgaard 41 29 0 20 Jun 2022
A Benchmark for Compositional Visual Reasoning Aimen Zerroug Mohit Vaishnav Julien Colin Sebastian Musslick Thomas Serre OCL CoGe 28 28 0 11 Jun 2022
A computational psycholinguistic evaluation of the syntactic abilities of Galician BERT models at the interface of dependency resolution and training time Iria de-Dios-Flores Marcos Garcia 25 2 0 06 Jun 2022
Order-sensitive Shapley Values for Evaluating Conceptual Soundness of NLP Models Kaiji Lu Anupam Datta 26 0 0 01 Jun 2022
Linear Connectivity Reveals Generalization Strategies Jeevesh Juneja Rachit Bansal Kyunghyun Cho João Sedoc Naomi Saphra 244 45 0 24 May 2022
Blackbird's language matrices (BLMs): a new benchmark to investigate disentangled generalisation in neural networks Paola Merlo A. An M. A. Rodriguez 38 9 0 22 May 2022
Acceptability Judgements via Examining the Topology of Attention Maps D. Cherniavskii Eduard Tulchinskii Vladislav Mikhailov Irina Proskurina Laida Kushnareva Ekaterina Artemova S. Barannikov Irina Piontkovskaya D. Piontkovski Evgeny Burnaev 780 19 0 19 May 2022
Assessing the Limits of the Distributional Hypothesis in Semantic Spaces: Trait-based Relational Knowledge and the Impact of Co-occurrences Mark Anderson Jose Camacho-Collados 35 0 0 16 May 2022
Discovering Latent Concepts Learned in BERT Fahim Dalvi A. Khan Firoj Alam Nadir Durrani Jia Xu Hassan Sajjad SSL 11 56 0 15 May 2022
Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models? Lukas Thoma Benjamin Roth 28 0 0 12 May 2022
When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it Sebastian Schuster Tal Linzen 15 25 0 06 May 2022
Implicit N-grams Induced by Recurrence Xiaobing Sun Wei Lu 27 3 0 05 May 2022
When Does Syntax Mediate Neural Language Model Performance? Evidence from Dropout Probes Mycal Tucker Tiwalayo Eisape Peng Qian R. Levy J. Shah MILM 28 12 0 20 Apr 2022
Probing for the Usage of Grammatical Number Karim Lasri Tiago Pimentel Alessandro Lenci Thierry Poibeau Ryan Cotterell 38 55 0 19 Apr 2022
Multilingual Syntax-aware Language Modeling through Dependency Tree Conversion Shun Kando Hiroshi Noji Yusuke Miyao 21 0 0 19 Apr 2022
Does BERT really agree ? Fine-grained Analysis of Lexical Dependence on a Syntactic Task Karim Lasri Alessandro Lenci Thierry Poibeau 28 13 0 14 Apr 2022
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality Tristan Thrush Ryan Jiang Max Bartolo Amanpreet Singh Adina Williams Douwe Kiela Candace Ross CoGe 36 404 0 07 Apr 2022
minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models Kanishka Misra 19 58 0 24 Mar 2022
Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translation Beatrice Savoldi Marco Gaido L. Bentivogli Matteo Negri Marco Turchi 38 26 0 18 Mar 2022
Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models Aaron Mueller Robert Frank Tal Linzen Luheng Wang Sebastian Schuster AIMat 19 33 0 17 Mar 2022
Measuring the Mixing of Contextual Information in the Transformer Javier Ferrando Gerard I. Gállego Marta R. Costa-jussá 36 50 0 08 Mar 2022
Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale Laurent Sartran Samuel Barrett A. Kuncoro Milovs Stanojević Phil Blunsom Chris Dyer 50 49 0 01 Mar 2022
Neural reality of argument structure constructions Bai Li Zining Zhu Guillaume Thomas Frank Rudzicz Yang Xu 48 27 0 24 Feb 2022
Compositional Generalization Requires Compositional Parsers Pia Weissenhorn Yuekun Yao L. Donatelli Alexander Koller CoGe 25 3 0 24 Feb 2022
Grammatical cues to subjecthood are redundant in a majority of simple clauses across languages Kyle Mahowald Evgeniia Diachek E. Gibson Evelina Fedorenko Richard Futrell 34 10 0 30 Jan 2022
Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Tasks Haoyu Dong Zhoujun Cheng Xinyi He Mengyuan Zhou Anda Zhou Fan Zhou Ao Liu Shi Han Dongmei Zhang LMTD 65 64 0 24 Jan 2022
An Application of Pseudo-Log-Likelihoods to Natural Language Scoring Darren Abramson Ali Emami 46 3 0 23 Jan 2022
A Latent-Variable Model for Intrinsic Probing Karolina Stañczak Lucas Torroba Hennigen Adina Williams Ryan Cotterell Isabelle Augenstein 29 4 0 20 Jan 2022
Interpreting Arabic Transformer Models Ahmed Abdelali Nadir Durrani Fahim Dalvi Hassan Sajjad 41 2 0 19 Jan 2022
Data-driven Model Generalizability in Crosslinguistic Low-resource Morphological Segmentation Zoey Liu Emily Tucker Prudhommeaux 45 4 0 05 Jan 2022
Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability Kyle Richardson Ashish Sabharwal ReLM LRM 35 24 0 16 Dec 2021
Linguistic Frameworks Go Toe-to-Toe at Neuro-Symbolic Language Modeling Jakob Prange Nathan Schneider Lingpeng Kong 24 10 0 15 Dec 2021
Sparse Interventions in Language Models with Differentiable Masking Nicola De Cao Leon Schmid Dieuwke Hupkes Ivan Titov 40 27 0 13 Dec 2021
ORCHARD: A Benchmark For Measuring Systematic Generalization of Multi-Hierarchical Reasoning B. Pung Alvin Chan 8 0 0 28 Nov 2021
FastTrees: Parallel Latent Tree-Induction for Faster Sequence Encoding B. Pung Alvin Chan 18 0 0 28 Nov 2021
Variation and generality in encoding of syntactic anomaly information in sentence embeddings Qinxuan Wu Allyson Ettinger 23 2 0 12 Nov 2021
How Do Neural Sequence Models Generalize? Local and Global Context Cues for Out-of-Distribution Prediction Anthony Bau Jacob Andreas 27 3 0 04 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 83 1,038 0 01 Nov 2021
Schrödinger's Tree -- On Syntax and Neural Language Models Artur Kulmizev Joakim Nivre 35 6 0 17 Oct 2021
Causal Transformers Perform Below Chance on Recursive Nested Constructions, Unlike Humans Yair Lakretz T. Desbordes Dieuwke Hupkes S. Dehaene 233 11 0 14 Oct 2021
Inducing Transformer's Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks Yichen Jiang Joey Tianyi Zhou 100 25 0 30 Sep 2021
Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations Arabella J. Sinclair Jaap Jumelet Willem H. Zuidema Raquel Fernández 61 38 0 30 Sep 2021
Sorting through the noise: Testing robustness of information processing in pre-trained language models Lalchand Pandia Allyson Ettinger 49 37 0 25 Sep 2021
Monolingual and Cross-Lingual Acceptability Judgments with the Italian CoLA corpus Daniela Trotta R. Guarasci Elisa Leonardelli Sara Tonelli 44 30 0 24 Sep 2021