Revisiting Entropy Rate Constancy in Text

v1v2 (latest)

Revisiting Entropy Rate Constancy in Text

20 May 2023

Nicholas Tomlin

ArXiv (abs)PDF HTML

Papers citing "Revisiting Entropy Rate Constancy in Text"

11 / 11 papers shown

Title
Revisiting the Uniform Information Density Hypothesis Clara Meister Tiago Pimentel Patrick Haller Lena Jäger Ryan Cotterell R. Levy 94 77 0 23 Sep 2021
What Context Features Can Transformer Language Models Use? J. O'Connor Jacob Andreas KELM 60 79 0 15 Jun 2021
A Cognitive Regularizer for Language Modeling Jason W. Wei Clara Meister Ryan Cotterell 77 21 0 15 May 2021
Mind the Gap: Assessing Temporal Generalization in Neural Language Models Angeliki Lazaridou A. Kuncoro E. Gribovskaya Devang Agrawal Adam Liska ... Sebastian Ruder Dani Yogatama Kris Cao Susannah Young Phil Blunsom VLM 134 219 0 03 Feb 2021
AraGPT2: Pre-Trained Transformer for Arabic Language Generation Wissam Antoun Fady Baly Hazem M. Hajj VLM 66 105 0 31 Dec 2020
If beam search is the answer, what was the question? Clara Meister Tim Vieira Ryan Cotterell 76 143 0 06 Oct 2020
The PhotoBook Dataset: Building Common Ground through Visually-Grounded Dialogue J. Haber Tim Baumgärtner Ece Takmaz Lieke Gelderloos Elia Bruni Raquel Fernández 46 78 0 04 Jun 2019
Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Context Urvashi Khandelwal He He Peng Qi Dan Jurafsky RALM 62 298 0 12 May 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 808 132,725 0 12 Jun 2017
1.5 billion words Arabic Corpus I. A. El-Khair 3DV 65 98 0 12 Nov 2016
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 349 2,900 0 26 Sep 2016

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.