Can Language Models Learn Typologically Implausible Languages?

Can Language Models Learn Typologically Implausible Languages?

17 February 2025

Tatsuki Kuribayashi

Papers citing "Can Language Models Learn Typologically Implausible Languages?"

15 / 15 papers shown

Title
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Alex Warstadt Aaron Mueller Leshem Choshen E. Wilcox Chengxu Zhuang ... Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell 134 120 0 10 Apr 2025
Both Direct and Indirect Evidence Contribute to Dative Alternation Preferences in Language Models Qing Yao Kanishka Misra Leonie Weissweiler Kyle Mahowald 72 0 0 26 Mar 2025
Language Models as Models of Language Raphaël Millière 39 20 0 13 Aug 2024
What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages Nadav Borenstein Anej Svete R. Chan Josef Valvoda Franz Nowak Isabelle Augenstein Eleanor Chodroff Ryan Cotterell 58 13 0 06 Jun 2024
Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs Kanishka Misra Kyle Mahowald 83 27 0 28 Mar 2024
Mission: Impossible Language Models Julie Kallini Isabel Papadimitriou Richard Futrell Kyle Mahowald Christopher Potts ELM LRM 83 20 0 12 Jan 2024
Formal Language Recognition by Hard Attention Transformers: Perspectives from Circuit Complexity Sophie Hao Dana Angluin Robert Frank 43 77 0 13 Apr 2022
Examining the Inductive Bias of Neural Language Models with Artificial Languages Jennifer C. White Ryan Cotterell 57 44 0 02 Jun 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 517 40,739 0 22 Oct 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 125 2,724 0 05 Jun 2020
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages Peng Qi Yuhao Zhang Yuhui Zhang Jason Bolton Christopher D. Manning AI4TS 234 1,690 0 16 Mar 2020
Studying the Inductive Biases of RNNs with Synthetic Variations of Natural Languages Shauli Ravfogel Yoav Goldberg Tal Linzen 58 70 0 15 Mar 2019
Do Language Models Understand Anything? On the Ability of LSTMs to Understand Negative Polarity Items Jaap Jumelet Dieuwke Hupkes 52 63 0 31 Aug 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 591 130,942 0 12 Jun 2017
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 191 7,729 0 31 Aug 2015