Testing the limits of natural language models for predicting human
language judgments

v1v2v3 (latest)

Testing the limits of natural language models for predicting human language judgments

7 April 2022

Matthew Siegelman

N. Kriegeskorte

Christopher A. Baldassano

ArXiv (abs)PDF HTML

Papers citing "Testing the limits of natural language models for predicting human language judgments"

15 / 15 papers shown

Title
Syntactic Surprisal From Neural Models Predicts, But Underestimates, Human Processing Difficulty From Syntactic Ambiguities Suhas Arehalli Brian Dillon Tal Linzen 86 41 0 21 Oct 2022
Red Teaming Language Models with Language Models Ethan Perez Saffron Huang Francis Song Trevor Cai Roman Ring John Aslanides Amelia Glaese Nat McAleese G. Irving AAML 177 667 0 07 Feb 2022
Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude? J. Michaelov Megan D. Bardolph S. Coulson Benjamin Bergen 51 23 0 20 Jul 2021
A Targeted Assessment of Incremental Processing in Neural LanguageModels and Humans Ethan Gotlieb Wilcox P. Vani R. Levy 62 36 0 06 Jun 2021
Dynabench: Rethinking Benchmarking in NLP Douwe Kiela Max Bartolo Yixin Nie Divyansh Kaushik Atticus Geiger ... Pontus Stenetorp Robin Jia Joey Tianyi Zhou Christopher Potts Adina Williams 208 409 0 07 Apr 2021
Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future Grace W. Lindsay MedIm 97 434 0 20 Jan 2020
BLiMP: The Benchmark of Linguistic Minimal Pairs for English Alex Warstadt Alicia Parrish Haokun Liu Anhad Mohananey Wei Peng Sheng-Fu Wang Samuel R. Bowman 85 493 0 02 Dec 2019
Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain) Mariya Toneva Leila Wehbe MILM AI4CE 77 230 0 28 May 2019
Human vs. Muppet: A Conservative Estimate of Human Performance on the GLUE Benchmark Nikita Nangia Samuel R. Bowman ELM ALM 69 76 0 24 May 2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems Alex Jinpeng Wang Yada Pruksachatkun Nikita Nangia Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 274 2,323 0 02 May 2019
BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model Alex Jinpeng Wang Kyunghyun Cho VLM 88 358 0 11 Feb 2019
Generating Natural Language Adversarial Examples M. Alzantot Yash Sharma Ahmed Elgohary Bo-Jhang Ho Mani B. Srivastava Kai-Wei Chang AAML 412 933 0 21 Apr 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.1K 7,196 0 20 Apr 2018
Explaining and Harnessing Adversarial Examples Ian Goodfellow Jonathon Shlens Christian Szegedy AAML GAN 282 19,121 0 20 Dec 2014
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 282 14,963 1 21 Dec 2013