v1v2 (latest)

Signal in Noise: Exploring Meaning Encoded in Random Character Sequences with Character-Aware Language Models

15 March 2022

Mark Chu

Bhargav Srinivasa Desikan

Papers citing "Signal in Noise: Exploring Meaning Encoded in Random Character Sequences with Character-Aware Language Models"

21 / 21 papers shown

Title
Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex Words Valentin Hofmann J. Pierrehumbert Hinrich Schütze 74 72 0 02 Jan 2021
CharBERT: Character-aware Pre-trained Language Model Wentao Ma Yiming Cui Chenglei Si Ting Liu Shijin Wang Guoping Hu 73 107 0 03 Nov 2020
CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters Hicham El Boukkouri Olivier Ferret Thomas Lavergne Hiroshi Noji Pierre Zweigenbaum Junichi Tsujii 113 161 0 20 Oct 2020
comp-syn: Perceptually Grounded Word Embeddings with Color Bhargav Srinivasa Desikan Tasker Hull E. Nadler Douglas Guilbeault Aabir Abubaker Kar Mark Chu Donald Ruggiero Lo Sardo 34 7 0 08 Oct 2020
The curious case of developmental BERTology: On sparsity, transfer learning, generalization and the brain Xin Wang 34 1 0 07 Jul 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 814 42,055 0 28 May 2020
What are the Goals of Distributional Semantics? Guy Edward Toh Emerson 60 26 0 06 May 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 87 1,497 0 27 Feb 2020
How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings Kawin Ethayarajh 86 872 0 02 Sep 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 218 1,598 0 11 Jun 2019
Text Classification Algorithms: A Survey Kamran Kowsari K. Meimandi Mojtaba Heidarysafa Sanjana Mendu Laura E. Barnes Donald E. Brown 74 1,298 0 17 Apr 2019
Assessing BERT's Syntactic Abilities Yoav Goldberg 73 496 0 16 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 94,891 0 11 Oct 2018
Character-Level Language Modeling with Deeper Self-Attention Rami Al-Rfou Dokook Choe Noah Constant Mandy Guo Llion Jones 138 391 0 09 Aug 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 214 11,556 0 15 Feb 2018
A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction Shamil Chollampatt Hwee Tou Ng KELM 54 222 0 26 Jan 2018
Neural Language Correction with Character-Based Attention Ziang Xie Anand Avati N. Arivazhagan Dan Jurafsky A. Ng 50 142 0 31 Mar 2016
Character-Aware Neural Language Models Yoon Kim Yacine Jernite David Sontag Alexander M. Rush 104 1,669 0 26 Aug 2015
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 437 20,568 0 10 Sep 2014
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 397 33,550 0 16 Oct 2013
On Prediction Using Variable Order Markov Models Ron Begleiter Ran El-Yaniv G. Yona 92 444 0 30 Jun 2011