BLiMP: The Benchmark of Linguistic Minimal Pairs for English

2 December 2019

Papers citing "BLiMP: The Benchmark of Linguistic Minimal Pairs for English"

50 / 125 papers shown

Title
$K$ -MSHC: Unmasking Minimally Sufficient Head Circuits in Large Language Models with Experiments on Syntactic Classification Tasks Pratim Chowdhary 22 0 0 18 May 2025
For GPT-4 as with Humans: Information Structure Predicts Acceptability of Long-Distance Dependencies Nicole Cuneo Eleanor Graves Supantho Rakshit Adele E. Goldberg 31 0 0 13 May 2025
Towards Developmentally Plausible Rewards: Communicative Success as a Learning Signal for Interactive Language Models Lennart Stöpler Rufat Asadli Mitja Nikolaus Ryan Cotterell Alex Warstadt LRM 54 0 0 09 May 2025
Understanding LLM Scientific Reasoning through Promptings and Model's Explanation on the Answers Alice Rueda Mohammed S. Hassan Argyrios Perivolaris Bazen G. Teferra Reza Samavi ... Y. Wu Wenjie Qu Bo Cao Divya Sharma Sridhar Krishnan Venkat Bhat ELM LRM 58 0 0 02 May 2025
Mixture of Sparse Attention: Content-Based Learnable Sparse Attention via Expert-Choice Routing Piotr Piekos Róbert Csordás Jürgen Schmidhuber MoE VLM 108 1 0 01 May 2025
FLUKE: A Linguistically-Driven and Task-Agnostic Framework for Robustness Evaluation Yulia Otmakhova Hung Thinh Truong Rahmad Mahendra Zenan Zhai Rongxin Zhu Daniel Beck Jey Han Lau ELM 94 0 0 24 Apr 2025
Parameterized Synthetic Text Generation with SimpleStories Lennart Finke Chandan Sreedhara Thomas Dooms Mat Allen Emerald Zhang Juan Diego Rodriguez Noa Nabeshima Thomas Marshall Dan Braun SyDa 39 0 0 12 Apr 2025
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Alex Warstadt Aaron Mueller Leshem Choshen E. Wilcox Chengxu Zhuang ... Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell 54 110 0 10 Apr 2025
Pretraining Language Models for Diachronic Linguistic Change Discovery Elisabeth Fittschen Sabrina Li Tom Lippincott Leshem Choshen Craig Messner 33 0 0 07 Apr 2025
Regional Tiny Stories: Using Small Models to Compare Language Learning and Tokenizer Performance Nirvan Patil Malhar Abhay Inamdar Agnivo Gosai Guruprasad Pathak Anish Joshi Aryan Sagavekar Anish Joshirao Raj Abhijit Dandekar Rajat Dandekar Sreedath Panat 46 0 0 07 Apr 2025
Language Models at the Syntax-Semantics Interface: A Case Study of the Long-Distance Binding of Chinese Reflexive ziji Xiulin Yang 42 0 0 02 Apr 2025
Are formal and functional linguistic mechanisms dissociated in language models? Michael Hanna Sandro Pezzelle Yonatan Belinkov 57 0 0 14 Mar 2025
Who Relies More on World Knowledge and Bias for Syntactic Ambiguity Resolution: Humans or LLMs? So Young Lee Russell Scheinberg Amber Shore Ameeta Agrawal 58 1 0 13 Mar 2025
Language Models Fail to Introspect About Their Knowledge of Language Siyuan Song Jennifer Hu Kyle Mahowald LRM KELM HILM ELM 89 2 0 10 Mar 2025
Evaluating Discourse Cohesion in Pre-trained Language Models Jie He Wanqiu Long Deyi Xiong ELM 73 2 0 08 Mar 2025
Tgea: An error-annotated dataset and benchmark tasks for text generation from pretrained language models Jie He Bo Peng Yi-Lun Liao Qun Liu Deyi Xiong 73 8 0 06 Mar 2025
Shades of Zero: Distinguishing Impossibility from Inconceivability Jennifer Hu Felix Sosa T. Ullman 51 0 0 27 Feb 2025
BERTtime Stories: Investigating the Role of Synthetic Story Data in Language Pre-training Nikitas Theodoropoulos Giorgos Filandrianos Vassilis Lyberatos Maria Lymperaiou Giorgos Stamou SyDa 67 1 0 24 Feb 2025
Mechanistic Unveiling of Transformer Circuits: Self-Influence as a Key to Model Reasoning Lefei Zhang Lijie Hu Di Wang LRM 102 1 0 17 Feb 2025
A Distributional Perspective on Word Learning in Neural Language Models Filippo Ficarra Ryan Cotterell Alex Warstadt 61 1 0 09 Feb 2025
The potential -- and the pitfalls -- of using pre-trained language models as cognitive science theories Raj Sanjay Shah Sashank Varma LRM 96 0 0 22 Jan 2025
GPT or BERT: why not both? Lucas Georges Gabriel Charpentier David Samuel 67 5 0 31 Dec 2024
Sneaking Syntax into Transformer Language Models with Tree Regularization Ananjan Nandi Christopher D. Manning Shikhar Murty 75 0 0 28 Nov 2024
BabyLM Challenge: Exploring the Effect of Variation Sets on Language Model Training Efficiency Akari Haga Akiyo Fukatsu Miyu Oba Arianna Bisazza Yohei Oseki 37 1 0 14 Nov 2024
What Goes Into a LM Acceptability Judgment? Rethinking the Impact of Frequency and Length Lindia Tjuatja Graham Neubig Tal Linzen Sophie Hao 49 2 0 04 Nov 2024
The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Units Badr AlKhamissi Greta Tuckute Antoine Bosselut Martin Schrimpf MILM 52 10 0 04 Nov 2024
Linguistically Grounded Analysis of Language Models using Shapley Head Values Marcell Richard Fekete Johannes Bjerva 36 0 0 17 Oct 2024
TopoLM: brain-like spatio-functional organization in a topographic language model Neil Rathi Johannes Mehrer Badr AlKhamissi Taha Binhuraib Nicholas M. Blauch Martin Schrimpf 38 3 0 15 Oct 2024
Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language Models Xinyu Zhou Delong Chen Samuel Cahyawijaya Xufeng Duan Zhenguang G. Cai 42 1 0 19 Sep 2024
How to Make the Most of LLMs' Grammatical Knowledge for Acceptability Judgments Yusuke Ide Yuto Nishida Miyu Oba Miyu Oba Justin Vasselli Hidetaka Kamigaito Taro Watanabe 46 2 0 19 Aug 2024
LLMs' morphological analyses of complex FST-generated Finnish words Anssi Moisio Mathias Creutz M. Kurimo 54 1 0 11 Jul 2024
RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs Ekaterina Taktasheva Maxim Bazhukov Kirill Koncha Alena Fenogenova Ekaterina Artemova Vladislav Mikhailov 44 9 0 27 Jun 2024
BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pretraining of BabyLM Zhewen Shen Aditya Joshi Ruey-Cheng Chen CLL 57 2 0 17 Jun 2024
Filtered Corpus Training (FiCT) Shows that Language Models can Generalize from Indirect Evidence Abhinav Patil Jaap Jumelet Yu Ying Chiu Andy Lapastora Peter Shen Lexie Wang Clevis Willrich Shane Steinert-Threlkeld 44 13 0 24 May 2024
Natural Language Processing RELIES on Linguistics Juri Opitz Shira Wein Nathan Schneider AI4CE 60 7 0 09 May 2024
From Human Judgements to Predictive Models: Unravelling Acceptability in Code-Mixed Sentences Prashant Kodali Anmol Goel Likhith Asapu Vamshi Krishna Bonagiri Anirudh Govil Monojit Choudhury Manish Shrivastava Ponnurangam Kumaraguru 55 1 0 09 May 2024
What does the Knowledge Neuron Thesis Have to do with Knowledge? Jingcheng Niu Andrew Liu Zining Zhu Gerald Penn 53 31 0 03 May 2024
Decoding Probing: Revealing Internal Linguistic Structures in Neural Language Models using Minimal Pairs Linyang He Peili Chen Ercong Nie Yuanning Li Jonathan R. Brennan 36 6 0 26 Mar 2024
Acquiring Linguistic Knowledge from Multimodal Input Theodor Amariucai Alexander Scott Warstadt CLL 47 2 0 27 Feb 2024
DYAD: A Descriptive Yet Abjuring Density efficient approximation to linear neural network layers S. Chandy Varun Gangal Yi Yang Gabriel Maggiotti 39 0 0 11 Dec 2023
MELA: Multilingual Evaluation of Linguistic Acceptability Ziyin Zhang Yikang Liu Wei Huang Junyu Mao Rui Wang Hai Hu 35 3 0 15 Nov 2023
Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model Abhijith Chintam Rahel Beloch Willem H. Zuidema Michael Hanna Oskar van der Wal 35 16 0 19 Oct 2023
CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models Sreyan Ghosh Ashish Seth Sonal Kumar Utkarsh Tyagi Chandra Kiran Reddy Evuru S. Ramaneswaran S. Sakshi Oriol Nieto R. Duraiswami Dinesh Manocha AuLLM VLM CoGe 48 23 0 12 Oct 2023
Foundation Metrics for Evaluating Effectiveness of Healthcare Conversations Powered by Generative AI Mahyar Abbasian Elahe Khatibi Iman Azimi David Oniani Zahra Shakeri Hossein Abad ... Bryant Lin Olivier Gevaert Li-Jia Li Ramesh C. Jain Amir M. Rahmani LM&MA ELM AI4MH 50 66 0 21 Sep 2023
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features Ester Hlavnova Sebastian Ruder 42 5 0 11 Jul 2023
NoCoLA: The Norwegian Corpus of Linguistic Acceptability Matias Jentoft David Samuel 32 11 0 13 Jun 2023
Adverbs, Surprisingly Dmitry Nikolaev Collin F. Baker Miriam R. L. Petruck Sebastian Padó 31 1 0 31 May 2023
SLABERT Talk Pretty One Day: Modeling Second Language Acquisition with BERT Aditya Yadavalli Alekhya Yadavalli Vera Tobin 24 6 0 31 May 2023
Syntax and Semantics Meet in the "Middle": Probing the Syntax-Semantics Interface of LMs Through Agentivity Lindia Tjuatja Emmy Liu Lori S. Levin Graham Neubig 43 2 0 29 May 2023
Backpack Language Models John Hewitt John Thickstun Christopher D. Manning Percy Liang KELM 25 16 0 26 May 2023