Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies

4 November 2016

Papers citing "Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies"

50 / 496 papers shown

Title
Scope Ambiguities in Large Language Models Gaurav Kamath Sebastian Schuster Sowmya Vajjala Siva Reddy 34 3 0 05 Apr 2024
Auxiliary task demands mask the capabilities of smaller language models Jennifer Hu Michael C. Frank ELM 36 25 0 03 Apr 2024
Toward Informal Language Processing: Knowledge of Slang in Large Language Models Zhewei Sun Qian Hu Rahul Gupta Richard Zemel Yang Xu 46 1 0 02 Apr 2024
Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs Kanishka Misra Kyle Mahowald 55 24 0 28 Mar 2024
Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanisms Michael Hanna Sandro Pezzelle Yonatan Belinkov 53 35 0 26 Mar 2024
Different Tokenization Schemes Lead to Comparable Performance in Spanish Number Agreement Catherine Arnett Pamela D. Rivière Tyler A. Chang Sean Trott 24 2 0 20 Mar 2024
Investigating grammatical abstraction in language models using few-shot learning of novel noun gender Priyanka Sukumaran Conor Houghton N. Kazanina 46 0 0 15 Mar 2024
CausalGym: Benchmarking causal interpretability methods on linguistic tasks Aryaman Arora Daniel Jurafsky Christopher Potts 50 22 0 19 Feb 2024
Punctuation Restoration Improves Structure Understanding Without Supervision Junghyun Min Minho Lee Woochul Lee Yeonsoo Lee 62 1 0 13 Feb 2024
Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings Yichen Jiang Xiang Zhou Mohit Bansal 37 1 0 09 Feb 2024
Prosody in Cascade and Direct Speech-to-Text Translation: a case study on Korean Wh-Phrases Giulio Zhou Tsz Kin Lam Alexandra Birch Barry Haddow 55 4 0 01 Feb 2024
Quantum Transfer Learning for Acceptability Judgements Giuseppe Buonaiuto Raffaele Guarasci Aniello Minutolo G. De Pietro M. Esposito 44 7 0 15 Jan 2024
Experimental Contexts Can Facilitate Robust Semantic Property Inference in Language Models, but Inconsistently Kanishka Misra Allyson Ettinger Kyle Mahowald 38 4 0 12 Jan 2024
I am a Strange Dataset: Metalinguistic Tests for Language Models Tristan Thrush Jared Moore Miguel Monares Christopher Potts Douwe Kiela 24 5 0 10 Jan 2024
Exploring the Sensitivity of LLMs' Decision-Making Capabilities: Insights from Prompt Variation and Hyperparameters Manikanta Loya Divya Sinha Richard Futrell 23 35 0 29 Dec 2023
Disentangling continuous and discrete linguistic signals in transformer-based sentence embeddings Vivi Nastase Paola Merlo 21 0 0 18 Dec 2023
Grammatical information in BERT sentence embeddings as two-dimensional arrays Vivi Nastase Paola Merlo 32 6 0 15 Dec 2023
Neither hype nor gloom do DNNs justice Gaurav Malhotra Christian Tsvetkov B. D. Evans 34 117 0 08 Dec 2023
The Case for Scalable, Data-Driven Theory: A Paradigm for Scientific Progress in NLP Julian Michael 19 1 0 01 Dec 2023
Assessing the influence of attractor-verb distance on grammatical agreement in humans and language models Christos-Nikolaos Zacharopoulos T. Desbordes Mathias Sablé-Meyer 17 0 0 28 Nov 2023
MELA: Multilingual Evaluation of Linguistic Acceptability Ziyin Zhang Yikang Liu Wei Huang Junyu Mao Rui Wang Hai Hu 30 3 0 15 Nov 2023
Comparing Generalization in Learning with Limited Numbers of Exemplars: Transformer vs. RNN in Attractor Dynamics Rui Fukushima Jun Tani 11 0 0 15 Nov 2023
How Well Do Text Embedding Models Understand Syntax? Yan Zhang Zhaopeng Feng Zhiyang Teng Zuozhu Liu Haizhou Li 42 3 0 14 Nov 2023
In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax Aaron Mueller Albert Webson Jackson Petty Tal Linzen ReLM LRM 36 14 0 13 Nov 2023
How Abstract Is Linguistic Generalization in Large Language Models? Experiments with Argument Structure Michael Wilson Jackson Petty Robert Frank 26 15 0 08 Nov 2023
Data Factors for Better Compositional Generalization Xiang Zhou Yichen Jiang Mohit Bansal CoGe OOD 32 5 0 08 Nov 2023
Uncovering Intermediate Variables in Transformers using Circuit Probing Michael A. Lepori Thomas Serre Ellie Pavlick 78 7 0 07 Nov 2023
Can Language Models Be Tricked by Language Illusions? Easier with Syntax, Harder with Semantics Yuhan Zhang Edward Gibson Forrest Davis 41 6 0 02 Nov 2023
A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models Tiwalayo Eisape MH Tessler Ishita Dasgupta Fei Sha Sjoerd van Steenkiste Tal Linzen ReLM LRM 43 8 0 01 Nov 2023
Evaluating Neural Language Models as Cognitive Models of Language Acquisition Héctor Javier Vázquez Martínez Annika Lea Heuser Charles D. Yang Jordan Kodner 36 8 0 31 Oct 2023
Lil-Bevo: Explorations of Strategies for Training Language Models in More Humanlike Ways Venkata S Govindarajan Juan Diego Rodriguez Kaj Bostrom Kyle Mahowald 25 1 0 26 Oct 2023
Unraveling Feature Extraction Mechanisms in Neural Networks Xiaobing Sun Jiaxi Li Wei Lu 23 0 0 25 Oct 2023
Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject Number Sophie Hao Tal Linzen 19 5 0 23 Oct 2023
When Language Models Fall in Love: Animacy Processing in Transformer Language Models Michael Hanna Yonatan Belinkov Sandro Pezzelle 30 11 0 23 Oct 2023
Large Language Models are biased to overestimate profoundness Eugenio Herrera-Berg Tomás Vergara Browne Pablo León-Villagrá Marc-Lluís Vives Cristian Buc Calderon ELM 36 6 0 22 Oct 2023
Implications of Annotation Artifacts in Edge Probing Test Datasets Sagnik Ray Choudhury Jushaan Kalra 16 0 0 20 Oct 2023
On the Representational Capacity of Recurrent Neural Language Models Franz Nowak Anej Svete Li Du Ryan Cotterell 29 1 0 19 Oct 2023
Disentangling the Linguistic Competence of Privacy-Preserving BERT Stefan Arnold Nils Kemmerzell Annika Schreiner 35 0 0 17 Oct 2023
CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models Sreyan Ghosh Ashish Seth Sonal Kumar Utkarsh Tyagi Chandra Kiran Reddy Evuru S. Ramaneswaran S. Sakshi Oriol Nieto R. Duraiswami Dinesh Manocha AuLLM VLM CoGe 45 23 0 12 Oct 2023
Recurrent Neural Language Models as Probabilistic Finite-state Automata Anej Svete Ryan Cotterell 42 2 0 08 Oct 2023
Model Complexity of Program Phases Arjun Karuvally J. E. B. Moss 20 0 0 05 Oct 2023
JCoLA: Japanese Corpus of Linguistic Acceptability Taiga Someya Yushi Sugimoto Yohei Oseki 32 5 0 22 Sep 2023
BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Models Wei Qi Leong Jian Gang Ngui Yosephine Susanto Hamsawardhini Rengarajan Kengatharaiyer Sarveswaran William-Chandra Tjhi 29 9 0 12 Sep 2023
Learning the meanings of function words from grounded language using a visual question answering model Eva Portelance Michael C. Frank Dan Jurafsky NAI 33 7 0 16 Aug 2023
A Geometric Notion of Causal Probing Clément Guerner Anej Svete Tianyu Liu Alex Warstadt Ryan Cotterell LLMSV 41 12 0 27 Jul 2023
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features Ester Hlavnova Sebastian Ruder 38 5 0 11 Jul 2023
Generalizing Backpropagation for Gradient-Based Interpretability Kevin Du Lucas Torroba Hennigen Niklas Stoehr Alex Warstadt Ryan Cotterell MILM FAtt 32 7 0 06 Jul 2023
Language Models Can Learn Exceptions to Syntactic Rules Cara Su-Yi Tal Linzen 11 6 0 09 Jun 2023
Language acquisition: do children and language models follow similar learning stages? Linnea Evanson Yair Lakretz J. King 32 27 0 06 Jun 2023
Second Language Acquisition of Neural Language Models Miyu Oba Tatsuki Kuribayashi Hiroki Ouchi Taro Watanabe 25 5 0 05 Jun 2023