Language models align with human judgments on key grammatical
constructions

Language models align with human judgments on key grammatical constructions

19 January 2024

Anna A. Ivanova

Papers citing "Language models align with human judgments on key grammatical constructions"

13 / 13 papers shown

Title
For GPT-4 as with Humans: Information Structure Predicts Acceptability of Long-Distance Dependencies Nicole Cuneo Eleanor Graves Supantho Rakshit Adele E. Goldberg 14 0 0 13 May 2025
Signatures of human-like processing in Transformer forward passes Jennifer Hu Michael A. Lepori Michael Franke AI4CE 156 0 0 18 Apr 2025
MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairs Jaap Jumelet Leonie Weissweiler Arianna Bisazza 38 2 0 03 Apr 2025
Leveraging Human Production-Interpretation Asymmetries to Test LLM Cognitive Plausibility S. Lam Qingcheng Zeng Jingyi Wu Rob Voigt 47 0 0 21 Mar 2025
Language Models Fail to Introspect About Their Knowledge of Language Siyuan Song Jennifer Hu Kyle Mahowald LRM KELM HILM ELM 79 2 0 10 Mar 2025
Large Language Models Are Human-Like Internally Tatsuki Kuribayashi Yohei Oseki Souhaib Ben Taieb Kentaro Inui Timothy Baldwin 69 4 0 03 Feb 2025
The potential -- and the pitfalls -- of using pre-trained language models as cognitive science theories Raj Sanjay Shah Sashank Varma LRM 89 0 0 22 Jan 2025
From Words to Worlds: Compositionality for Cognitive Architectures Ruchira Dhar Anders Sogaard 40 0 0 18 Jul 2024
Elements of World Knowledge (EWOK): A cognition-inspired framework for evaluating basic world knowledge in language models Anna A. Ivanova Aalok Sathe Benjamin Lipkin Unnathi Kumar S. Radkani ... Leshem Choshen Roger Levy Evelina Fedorenko Josh Tenenbaum Jacob Andreas 38 23 0 15 May 2024
Language in Vivo vs. in Silico: Size Matters but Larger Language Models Still Do Not Comprehend Language on a Par with Humans Vittoria Dentella Fritz Guenther Evelina Leivada ELM 46 1 0 23 Apr 2024
Auxiliary task demands mask the capabilities of smaller language models Jennifer Hu Michael C. Frank ELM 34 25 0 03 Apr 2024
CausalGym: Benchmarking causal interpretability methods on linguistic tasks Aryaman Arora Daniel Jurafsky Christopher Potts 50 21 0 19 Feb 2024
Testing AI on language comprehension tasks reveals insensitivity to underlying meaning Vittoria Dentella Fritz Guenther Elliot Murphy G. Marcus Evelina Leivada ELM 40 26 0 23 Feb 2023