Neural Machine Translation with Byte-Level Subwords

7 September 2019

Papers citing "Neural Machine Translation with Byte-Level Subwords"

29 / 29 papers shown

Title
Qwen3 Technical Report An Yang A. Li Baosong Yang Beichen Zhang Binyuan Hui ... Zekun Wang Zeyu Cui Zhenru Zhang Zhenhong Zhou Zihan Qiu LLMAG OSLM LRM 47 0 0 14 May 2025
Self-Vocabularizing Training for Neural Machine Translation Pin-Jie Lin Ernie Chang Yangyang Shi Vikas Chandra 65 0 0 18 Mar 2025
CORAL: Learning Consistent Representations across Multi-step Training with Lighter Speculative Drafter Yepeng Weng Dianwen Mei Huishi Qiu Xujie Chen Li Liu Jiang Tian Zhongchao Shi 53 0 0 24 Feb 2025
Multilingual Attribute Extraction from News Web Pages Pavel Bedrin Maksim Varlamov Alexander Yatskov 59 1 0 04 Feb 2025
MorphBPE: A Morpho-Aware Tokenizer Bridging Linguistic Complexity for Efficient LLM Training Across Morphologies Ehsaneddin Asgari Yassine El Kheir Mohammad Ali Sadraei Javaheri 74 0 0 02 Feb 2025
Dual-Pipeline with Low-Rank Adaptation for New Language Integration in Multilingual ASR Yerbolat Khassanov Zhipeng Chen Tianfeng Chen Tze Yuang Chong Wei Li Jun Zhang Lu Lu Yuxuan Wang AI4CE 29 0 0 12 Jun 2024
A Systematic Analysis of Subwords and Cross-Lingual Transfer in Multilingual Translation Francois Meyer Jan Buys 39 1 0 29 Mar 2024
Stolen Subwords: Importance of Vocabularies for Machine Translation Model Stealing Vilém Zouhar AAML 40 0 0 29 Jan 2024
Multi-teacher Distillation for Multilingual Spelling Correction Jingfen Zhang Xuan Guo S. Bodapati Christopher Potts KELM 27 3 0 20 Nov 2023
How Vocabulary Sharing Facilitates Multilingualism in LLaMA? Fei Yuan Shuai Yuan Zhiyong Wu Lei Li 37 10 0 15 Nov 2023
A Comparative Study of Pretrained Language Models for Long Clinical Text Yikuan Li R. M. Wehbe F. Ahmad Hanyin Wang Yuan Luo LM&MA ELM VLM MedIm 29 79 0 27 Jan 2023
Foresight -- Generative Pretrained Transformer (GPT) for Modelling of Patient Timelines using EHRs Z. Kraljevic D. Bean Anthony Shek R. Bendayan H. Hemingway ... Alfie Baston Jack Ross Esther Idowu J. Teo Richard J. B. Dobson AI4TS 24 20 0 13 Dec 2022
Pivotal Role of Language Modeling in Recommender Systems: Enriching Task-specific and Task-agnostic Representation Learning Kyuyong Shin Hanock Kwak Wonjae Kim Jisu Jeong Seungjae Jung KyungHyun Kim Jung-Woo Ha Sang-Woo Lee 27 4 0 07 Dec 2022
BudgetLongformer: Can we Cheaply Pretrain a SotA Legal Language Model From Scratch? Joel Niklaus Daniele Giofré 33 11 0 30 Nov 2022
Machine Learning with DBOS R. Redmond Nathan Weckwerth Brian Xia Qian Li Peter Kraft Deeptaanshu Kumar cCaugatay Demiralp Michael Stonebraker OOD 25 0 0 10 Aug 2022
Language Modelling with Pixels Phillip Rust Jonas F. Lotz Emanuele Bugliarello Elizabeth Salesky Miryam de Lhoneux Desmond Elliott VLM 38 46 0 14 Jul 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 49 149 0 15 Apr 2022
m-Nearly k-Universal Words -- Investigating Simon Congruence Pamela Fleischmann Lukas Haschke Annika Huch Annika Mayrock Dirk Nowotka 19 1 0 16 Feb 2022
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences Yikuan Li R. M. Wehbe F. Ahmad Hanyin Wang Yuan Luo VLM MedIm 150 85 0 27 Jan 2022
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP Sabrina J. Mielke Zaid Alyafeai Elizabeth Salesky Colin Raffel Manan Dey ... Arun Raja Chenglei Si Wilson Y. Lee Benoît Sagot Samson Tan 32 142 0 20 Dec 2021
Scaling Law for Recommendation Models: Towards General-purpose User Representations Kyuyong Shin Hanock Kwak KyungHyun Kim Max Nihlén Ramström Jisu Jeong Jung-Woo Ha S. Kim ELM 36 38 0 15 Nov 2021
Discontinuous Grammar as a Foreign Language Daniel Fernández-González Carlos Gómez-Rodríguez 50 9 0 20 Oct 2021
HTTP2vec: Embedding of HTTP Requests for Detection of Anomalous Traffic Mateusz Gniewkowski H. Maciejewski T. Surmacz Wiktor Walentynowicz 29 8 0 03 Aug 2021
Direct speech-to-speech translation with discrete units Ann Lee Peng-Jen Chen Changhan Wang Jiatao Gu Sravya Popuri ... Yossi Adi Qing He Yun Tang J. Pino Wei-Ning Hsu 38 180 0 12 Jul 2021
CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation J. Clark Dan Garrette Iulia Turc John Wieting 36 210 0 11 Mar 2021
Neural Machine Translation: A Review of Methods, Resources, and Tools Zhixing Tan Shuo Wang Zonghan Yang Gang Chen Xuancheng Huang Maosong Sun Yang Liu 3DV AI4TS 22 105 0 31 Dec 2020
Towards End-to-End In-Image Neural Machine Translation Elman Mansimov Mitchell Stern Mengzhao Chen Orhan Firat Jakob Uszkoreit Puneet Jain 27 25 0 20 Oct 2020
Comparative Analysis of Text Classification Approaches in Electronic Health Records Aurelie Mascio Z. Kraljevic D. Bean Richard J. B. Dobson Robert Stewart R. Bendayan A. Roberts 18 46 0 08 May 2020
Mind Your Inflections! Improving NLP for Non-Standard Englishes with Base-Inflection Encoding Samson Tan Chenyu You L. Varshney Min-Yen Kan 17 34 0 30 Apr 2020