Revenge of the Fallen? Recurrent Models Match Transformers at Predicting Human Language Comprehension Metrics

30 April 2024

Papers citing "Revenge of the Fallen? Recurrent Models Match Transformers at Predicting Human Language Comprehension Metrics"

16 / 16 papers shown

Title
Testing the Predictions of Surprisal Theory in 11 Languages Ethan Gotlieb Wilcox Tiago Pimentel Clara Meister Ryan Cotterell R. Levy LRM 83 69 0 07 Jul 2023
RWKV: Reinventing RNNs for the Transformer Era Bo Peng Eric Alcaide Quentin G. Anthony Alon Albalak Samuel Arcadinho ... Qihang Zhao P. Zhou Qinghua Zhou Jian Zhu Rui-Jie Zhu 212 594 0 22 May 2023
Transformer-Based Language Model Surprisal Predicts Human Reading Times Best with About Two Billion Training Tokens Byung-Doh Oh William Schuler 73 31 0 22 Apr 2023
Collateral facilitation in humans and language models J. Michaelov Benjamin Bergen 96 11 0 09 Nov 2022
Revisiting the Uniform Information Density Hypothesis Clara Meister Tiago Pimentel Patrick Haller Lena Jäger Ryan Cotterell R. Levy 83 76 0 23 Sep 2021
So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgements J. Michaelov S. Coulson Benjamin Bergen 55 44 0 02 Sep 2021
Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude? J. Michaelov Megan D. Bardolph S. Coulson Benjamin Bergen 46 23 0 20 Jul 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 278 2,453 0 20 Apr 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 450 2,096 0 31 Dec 2020
Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Priming Kanishka Misra Allyson Ettinger Julia Taylor Rayz 44 58 0 06 Oct 2020
Array Programming with NumPy Charles R. Harris K. Millman S. Walt R. Gommers Pauli Virtanen ... Tyler Reddy Warren Weckesser Hameer Abbasi C. Gohlke T. Oliphant 154 14,959 0 18 Jun 2020
On the Predictive Power of Neural Language Models for Human Real-Time Comprehension Behavior Ethan Gotlieb Wilcox Jon Gauthier Jennifer Hu Peng Qian R. Levy 45 169 0 02 Jun 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 602 4,822 0 23 Jan 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 496 42,449 0 03 Dec 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai Zhilin Yang Yiming Yang J. Carbonell Quoc V. Le Ruslan Salakhutdinov VLM 241 3,728 0 09 Jan 2019
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 319 2,859 0 26 Sep 2016