Linear Recency Bias During Training Improves Transformers' Fit to Reading Times

17 September 2024

Papers citing "Linear Recency Bias During Training Improves Transformers' Fit to Reading Times"

3 / 3 papers shown

Title
TRA: Better Length Generalisation with Threshold Relative Attention Mattia Opper Roland Fernandez P. Smolensky Jianfeng Gao 46 0 0 29 Mar 2025
Language Models Grow Less Humanlike beyond Phase Transition Tatsuya Aoyama Ethan Wilcox 46 1 0 26 Feb 2025
Accounting for Agreement Phenomena in Sentence Comprehension with Transformer Language Models: Effects of Similarity-based Interference on Surprisal and Attention S. Ryu Richard L. Lewis 36 25 0 26 Apr 2021