BERT Cannot Align Characters

20 September 2021

Papers citing "BERT Cannot Align Characters"

18 / 18 papers shown

Title
CharBERT: Character-aware Pre-trained Language Model Wentao Ma Yiming Cui Chenglei Si Ting Liu Shijin Wang Guoping Hu 51 106 0 03 Nov 2020
CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters Hicham El Boukkouri Olivier Ferret Thomas Lavergne Hiroshi Noji Pierre Zweigenbaum Junichi Tsujii 101 160 0 20 Oct 2020
Applying the Transformer to Character-level Transduction Shijie Wu Ryan Cotterell Mans Hulden AI4CE 48 106 0 20 May 2020
SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddings Masoud Jalili Sabet Philipp Dufter François Yvon Hinrich Schütze 54 235 0 18 Apr 2020
Cross-Lingual Ability of Multilingual BERT: An Empirical Study Karthikeyan K Zihan Wang Stephen D. Mayhew Dan Roth LRM 62 338 0 17 Dec 2019
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 161 793 0 25 Oct 2019
Don't Forget the Long Tail! A Comprehensive Analysis of Morphological Generalization in Bilingual Lexicon Induction Paula Czarnowska Sebastian Ruder Edouard Grave Ryan Cotterell Ann A. Copestake 68 50 0 06 Sep 2019
Jointly Learning to Align and Translate with Transformer Models Sarthak Garg Stephan Peitz Udhyakumar Nallasamy Matthias Paulik 32 172 0 04 Sep 2019
How multilingual is Multilingual BERT? Telmo Pires Eva Schlinger Dan Garrette LRM VLM 143 1,401 0 04 Jun 2019
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT Shijie Wu Mark Dredze VLM SSeg 89 677 0 19 Apr 2019
Adding Interpretable Attention to Neural Translation Models Improves Word Alignment Thomas Zenkel Joern Wuebker John DeNero 63 76 0 31 Jan 2019
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau 73 2,735 0 22 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.4K 94,511 0 11 Oct 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 626 130,942 0 12 Jun 2017
From Characters to Words to in Between: Do We Capture Morphology? Clara Vania Adam Lopez 43 96 0 26 Apr 2017
Enriching Word Vectors with Subword Information Piotr Bojanowski Edouard Grave Armand Joulin Tomas Mikolov NAI SSL VLM 209 9,953 0 15 Jul 2016
Neural Network-based Word Alignment through Score Aggregation Joël Legrand Michael Auli R. Collobert 41 27 0 30 Jun 2016
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 352 7,956 0 17 Aug 2015