Why don't people use character-level machine translation?

15 October 2021

Papers citing "Why don't people use character-level machine translation?"

48 / 48 papers shown

Title
Evaluating Morphological Compositional Generalization in Large Language Models Mete Ismayilzada Yuan Chiang Jonne Sälevä Hale Sirin Abdullatif Köksal Bhuwan Dhingra Antoine Bosselut Lonneke van der Plas Duygu Ataman 50 4 0 16 Oct 2024
Large Vocabulary Size Improves Large Language Models Sho Takase Ryokan Ri Shun Kiyono Takuya Kato 65 4 0 24 Jun 2024
What Do You Get When You Cross Beam Search with Nucleus Sampling? Uri Shaham Omer Levy 39 10 0 20 Jul 2021
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization Yi Tay Vinh Q. Tran Sebastian Ruder Jai Gupta Hyung Won Chung Dara Bahri Zhen Qin Simon Baumgartner Cong Yu Donald Metzler 75 155 0 23 Jun 2021
ByT5: Towards a token-free future with pre-trained byte-to-byte models Linting Xue Aditya Barua Noah Constant Rami Al-Rfou Sharan Narang Mihir Kale Adam Roberts Colin Raffel 73 494 0 28 May 2021
Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translation Mathias Müller Rico Sennrich 28 59 0 18 May 2021
CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation J. Clark Dan Garrette Iulia Turc John Wieting 75 214 0 11 Mar 2021
Why Neural Machine Translation Prefers Empty Outputs Xing Shi Yijun Xiao Kevin Knight AAML 22 9 0 24 Dec 2020
mT5: A massively multilingual pre-trained text-to-text transformer Linting Xue Noah Constant Adam Roberts Mihir Kale Rami Al-Rfou Aditya Siddhant Aditya Barua Colin Raffel 93 2,489 0 22 Oct 2020
Gender Coreference and Bias Evaluation at WMT 2020 Tom Kocmi Tomasz Limisiewicz Gabriel Stanovsky 10 29 0 12 Oct 2020
If beam search is the answer, what was the question? Clara Meister Tim Vieira Ryan Cotterell 36 139 0 06 Oct 2020
COMET: A Neural Framework for MT Evaluation Ricardo Rei Craig Alan Stewart Ana C. Farinha A. Lavie 94 1,075 0 18 Sep 2020
Neural Machine Translation without Embeddings Uri Shaham Omer Levy 25 15 0 21 Aug 2020
Announcing CzEng 2.0 Parallel Corpus with over 2 Gigawords Tom Kocmi Martin Popel Ondrej Bojar 16 38 0 06 Jul 2020
Character-level Transformer-based Neural Machine Translation Nikolay Banar Walter Daelemans M. Kestemont 25 20 0 22 May 2020
Is MAP Decoding All You Need? The Inadequacy of the Mode in Neural Machine Translation Bryan Eikema Wilker Aziz 43 132 0 20 May 2020
Character-Level Translation with Self-attention Yingqiang Gao Nikola I. Nikolov Yuhuang Hu Richard H. R. Hahnloser 28 27 0 30 Apr 2020
Character-based NMT with Transformer Rohit Gupta Laurent Besacier Marc Dymetman Matthias Gallé 39 23 0 12 Nov 2019
How Decoding Strategies Affect the Verifiability of Generated Text Luca Massarelli Fabio Petroni Aleksandra Piktus Myle Ott Tim Rocktaschel Vassilis Plachouras Fabrizio Silvestri Sebastian Riedel 60 50 0 09 Nov 2019
BPE-Dropout: Simple and Effective Subword Regularization Ivan Provilkov Dmitrii Emelianenko Elena Voita 53 279 0 29 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 265 19,824 0 23 Oct 2019
On the Importance of Word Boundaries in Character-level Neural Machine Translation Duygu Ataman Orhan Firat Mattia Antonino Di Gangi Marcello Federico Alexandra Birch 28 15 0 15 Oct 2019
On NMT Search Errors and Model Errors: Cat Got Your Tongue? Felix Stahlberg Bill Byrne LRM 49 152 0 27 Aug 2019
JUCBNMT at WMT2018 News Translation Task: Character Based Neural Machine Translation of Finnish to English S. Mahata Dipankar Das Sivaji Bandyopadhyay 14 3 0 01 Aug 2019
Findings of the First Shared Task on Machine Translation Robustness Xian Li Paul Michel Antonios Anastasopoulos Yonatan Belinkov Nadir Durrani Philipp Koehn Philipp Koehn Graham Neubig J. Pino Hassan Sajjad 38 60 0 27 Jun 2019
Tagged Back-Translation Isaac Caswell Ciprian Chelba David Grangier 84 218 0 15 Jun 2019
Evaluating Gender Bias in Machine Translation Gabriel Stanovsky Noah A. Smith Luke Zettlemoyer 56 397 0 03 Jun 2019
Revisiting Low-Resource Neural Machine Translation: A Case Study Rico Sennrich Biao Zhang 56 223 0 28 May 2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier Michael Auli VLM FaML 78 3,141 0 01 Apr 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 951 93,936 0 11 Oct 2018
Learning to Segment Inputs for NMT Favors Character-Level Processing Julia Kreutzer Artem Sokolov 36 31 0 02 Oct 2018
Neural Machine Translation of Logographic Languages Using Sub-character Level Information Longtu Zhang Mamoru Komachi 36 43 0 07 Sep 2018
Revisiting Character-Based Neural Machine Translation with Capacity and Compression Colin Cherry George F. Foster Ankur Bapna Orhan Firat Wolfgang Macherey 39 94 0 29 Aug 2018
Training Deeper Neural Machine Translation Models with Transparent Attention Ankur Bapna Mengzhao Chen Orhan Firat Yuan Cao Yonghui Wu 48 139 0 22 Aug 2018
SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing Taku Kudo John Richardson 144 3,490 0 19 Aug 2018
Character-level Chinese-English Translation through ASCII Encoding Nikola I. Nikolov Yuhuang Hu Mingyan Tan Richard H. R. Hahnloser AI4CE 24 31 0 09 May 2018
A Call for Clarity in Reporting BLEU Scores Matt Post 81 2,941 0 23 Apr 2018
Training Tips for the Transformer Model Martin Popel Ondrej Bojar 51 311 0 01 Apr 2018
The Helsinki Neural Machine Translation System Robert Östling Yves Scherrer Jörg Tiedemann Gongbo Tang Tommi Nieminen DRL 28 20 0 20 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 443 129,831 0 12 Jun 2017
How Grammatical is Character-level Neural Machine Translation? Assessing MT Quality with Contrastive Translation Pairs Rico Sennrich 66 165 0 14 Dec 2016
Fully Character-Level Neural Machine Translation without Explicit Segmentation Jason D. Lee Kyunghyun Cho Thomas Hofmann VLM 94 457 0 10 Oct 2016
Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Models Minh-Thang Luong Christopher D. Manning VLM 63 373 0 04 Apr 2016
A Character-Level Decoder without Explicit Segmentation for Neural Machine Translation Junyoung Chung Kyunghyun Cho Yoshua Bengio 54 333 0 19 Mar 2016
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 155 7,683 0 31 Aug 2015
Highway Networks R. Srivastava Klaus Greff Jürgen Schmidhuber 115 1,765 0 03 May 2015
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 280 20,491 0 10 Sep 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 388 27,205 0 01 Sep 2014