CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters

20 October 2020

Papers citing "CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters"

22 / 72 papers shown

Title
Rethinking the Authorship Verification Experimental Setups Florin Brad Andrei Manolache Elena Burceanu Antonio Bărbălău Radu Tudor Ionescu Marius Popescu 17 4 0 09 Dec 2021
Using Distributional Principles for the Semantic Study of Contextual Language Models Olivier Ferret 19 1 0 23 Nov 2021
Switch Point biased Self-Training: Re-purposing Pretrained Models for Code-Switching P. Chopra Sai Krishna Rallabandi A. Black Khyathi Raghavi Chandu 22 6 0 01 Nov 2021
Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios? Arij Riabi Benoît Sagot Djamé Seddah 31 15 0 26 Oct 2021
Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models Robert Wolfe Aylin Caliskan 85 51 0 01 Oct 2021
BERT Cannot Align Characters Antonis Maronikolakis Philipp Dufter Hinrich Schütze 25 0 0 20 Sep 2021
Integrating Approaches to Word Representation Yuval Pinter NAI 48 5 0 10 Sep 2021
How Suitable Are Subword Segmentation Strategies for Translating Non-Concatenative Morphology? Chantal Amrhein Rico Sennrich 27 13 0 02 Sep 2021
Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning Christos Theodoropoulos James Henderson Andrei Catalin Coman Marie-Francine Moens 27 15 0 02 Sep 2021
Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens Itay Itzhak Omer Levy 17 18 0 25 Aug 2021
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha VLM LM&MA 26 261 0 12 Aug 2021
Learning to Look Inside: Augmenting Token-Based Encoders with Character-Level Information Yuval Pinter Amanda Stent Mark Dredze Jacob Eisenstein 14 7 0 01 Aug 2021
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization Yi Tay Vinh Q. Tran Sebastian Ruder Jai Gupta Hyung Won Chung Dara Bahri Zhen Qin Simon Baumgartner Cong Yu Donald Metzler 51 152 0 23 Jun 2021
DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text Bharathi Raja Chakravarthi R. Priyadharshini Vigneshwaran Muralidaran Navya Jose Shardul Suryawanshi E. Sherly John P. Mccrae 25 105 0 17 Jun 2021
CodemixedNLP: An Extensible and Open NLP Toolkit for Code-Mixing Sai Muralidhar Jayanthi Kavya Nerella Khyathi Raghavi Chandu A. Black MoE 31 8 0 10 Jun 2021
ByT5: Towards a token-free future with pre-trained byte-to-byte models Linting Xue Aditya Barua Noah Constant Rami Al-Rfou Sharan Narang Mihir Kale Adam Roberts Colin Raffel 27 464 0 28 May 2021
IIITT@LT-EDI-EACL2021-Hope Speech Detection: There is always Hope in Transformers Karthik Puranik Adeep Hande R. Priyadharshini Sajeetha Thavareesan Bharathi Raja Chakravarthi 17 59 0 19 Apr 2021
AMMU : A Survey of Transformer-based Biomedical Pretrained Language Models Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha LM&MA MedIm 23 164 0 16 Apr 2021
UniParma at SemEval-2021 Task 5: Toxic Spans Detection Using CharacterBERT and Bag-of-Words Model Akbar Karimi L. Rossi Andrea Prati 29 4 0 17 Mar 2021
CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation J. Clark Dan Garrette Iulia Turc John Wieting 36 210 0 11 Mar 2021
Sensitive Data Detection with High-Throughput Neural Network Models for Financial Institutions A. Truong Austin Walters Jeremy Goodsitt AI4TS 6 7 0 17 Dec 2020
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016