Multilingual Denoising Pre-training for Neural Machine Translation

22 January 2020

Yinhan Liu

Jiatao Gu

Naman Goyal

Xian Li

Sergey Edunov

Luke Zettlemoyer

Papers citing "Multilingual Denoising Pre-training for Neural Machine Translation"

50 / 935 papers shown

Title
A High-Quality and Large-Scale Dataset for English-Vietnamese Speech Translation L. T. Nguyen Nguyen Luong Tran Long Doan Manh Luong Dat Quoc Nguyen 29 4 0 08 Aug 2022
Vernacular Search Query Translation with Unsupervised Domain Adaptation Mandar M. Kulkarni Nikesh Garera 24 1 0 07 Aug 2022
AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model Saleh Soltan Shankar Ananthakrishnan Jack G. M. FitzGerald Rahul Gupta Wael Hamza ... Mukund Sridhar Fabian Triefenbach Apurv Verma Gokhan Tur Premkumar Natarajan 58 82 0 02 Aug 2022
Sequence to sequence pretraining for a less-resourced Slovenian language Matej Ulčar Marko Robnik-Šikonja AIMat 32 17 0 28 Jul 2022
ArmanEmo: A Persian Dataset for Text-based Emotion Detection Hossein Mirzaee J. Peymanfard Hamid Habibzadeh Moshtaghin Hossein Zeinali 19 12 0 24 Jul 2022
Multilingual Transformer Encoders: a Word-Level Task-Agnostic Evaluation Félix Gaschi François Plesse Parisa Rastin Y. Toussaint 22 8 0 19 Jul 2022
Effectiveness of French Language Models on Abstractive Dialogue Summarization Task Yongxin Zhou Franccois Portet F. Ringeval 22 8 0 17 Jul 2022
u-HuBERT: Unified Mixed-Modal Speech Pretraining And Zero-Shot Transfer to Unlabeled Modality Wei-Ning Hsu Bowen Shi SSL VLM 29 42 0 14 Jul 2022
Learning to translate by learning to communicate C.M. Downey Xuhui Zhou Leo Z. Liu Shane Steinert-Threlkeld 34 5 0 14 Jul 2022
HLT-MT: High-resource Language-specific Training for Multilingual Neural Machine Translation Jian Yang Yuwei Yin Shuming Ma Dongdong Zhang Zhoujun Li Furu Wei 39 8 0 11 Jul 2022
Strong Heuristics for Named Entity Linking Marko Čuljak Andreas Spitz Robert West Akhil Arora 59 5 0 06 Jul 2022
M-Adapter: Modality Adaptation for End-to-End Speech-to-Text Translation Jinming Zhao Haomiao Yang Ehsan Shareghi Gholamreza Haffari 58 19 0 03 Jul 2022
"Diversity and Uncertainty in Moderation" are the Key to Data Selection for Multilingual Few-shot Transfer Shanu Kumar Sandipan Dandapat Monojit Choudhury 29 6 0 30 Jun 2022
Extreme compression of sentence-transformer ranker models: faster inference, longer battery life, and less storage on edge devices Amit Chaulwar Lukas Malik Maciej Krajewski Felix Reichel Leif-Nissen Lundbæk M. Huth B. Matejczyk VLM 22 3 0 29 Jun 2022
Link the World: Improving Open-domain Conversation with Dynamic Spatiotemporal-aware Knowledge Han Zhou Xinchao Xu Wenquan Wu Zheng-Yu Niu Hua Wu Siqi Bao Fan Wang Haifeng Wang KELM 35 7 0 28 Jun 2022
MVP: Multi-task Supervised Pre-training for Natural Language Generation Tianyi Tang Junyi Li Wayne Xin Zhao Ji-Rong Wen 54 24 0 24 Jun 2022
Insights into Pre-training via Simpler Synthetic Tasks Yuhuai Wu Felix Li Percy Liang AIMat 28 20 0 21 Jun 2022
Learning Multiscale Transformer Models for Sequence Generation Bei Li Tong Zheng Yi Jing Chengbo Jiao Tong Xiao Jingbo Zhu 32 9 0 19 Jun 2022
Automatic Summarization of Russian Texts: Comparison of Extractive and Abstractive Methods Valeriya Goloviznina Evgeny Kotelnikov 11 3 0 18 Jun 2022
niksss at HinglishEval: Language-agnostic BERT-based Contextual Embeddings with Catboost for Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Text Nikhil Singh 21 3 0 17 Jun 2022
XLCoST: A Benchmark Dataset for Cross-lingual Code Intelligence Ming Zhu Aneesh Jain Karthik Suresh Roshan Ravindran Sindhu Tipirneni Chandan K. Reddy 29 69 0 16 Jun 2022
DIALOG-22 RuATD Generated Text Detection Narek Maloyan Bulat Nutfullin Eugene Ilyushin DeLMO 30 8 0 16 Jun 2022
Cross-lingual AMR Aligner: Paying Attention to Cross-Attention Abelardo Carlos Martínez Lorenzo Pere-Lluís Huguet Cabot Roberto Navigli 38 4 0 15 Jun 2022
Location-based Twitter Filtering for the Creation of Low-Resource Language Datasets in Indonesian Local Languages Mukhlis Amien Chong Feng Heyan Huang 22 3 0 15 Jun 2022
What do tokens know about their characters and how do they know it? Ayush Kaushal Kyle Mahowald 32 28 0 06 Jun 2022
Bi-SimCut: A Simple Strategy for Boosting Neural Machine Translation Pengzhi Gao Zhongjun He Hua Wu Haifeng Wang 38 13 0 06 Jun 2022
Exploring Cross-lingual Textual Style Transfer with Large Multilingual Language Models Daniil Moskovskiy Daryna Dementieva Alexander Panchenko 28 3 0 05 Jun 2022
Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Search Michał Zawalski Michał Tyrolski K. Czechowski Tomasz Odrzygó'zd'z Damian Stachura Piotr Pikekos Yuhuai Wu Lukasz Kuciñski Piotr Milo's LRM 21 9 0 01 Jun 2022
NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages Genta Indra Winata Alham Fikri Aji Samuel Cahyawijaya Rahmad Mahendra Fajri Koto ... Pascale Fung Timothy Baldwin Jey Han Lau Rico Sennrich Sebastian Ruder 42 78 0 31 May 2022
Refining Low-Resource Unsupervised Translation by Language Disentanglement of Multilingual Model Xuan-Phi Nguyen Chenyu You Wu Kui Ai Ti Aw LRM 29 3 0 31 May 2022
X-SCITLDR: Cross-Lingual Extreme Summarization of Scholarly Documents Sotaro Takeshita Tommaso Green Niklas Friedrich Kai Eckert Simone Paolo Ponzetto 24 14 0 30 May 2022
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao 54 27 0 30 May 2022
TURJUMAN: A Public Toolkit for Neural Arabic Machine Translation El Moatez Billah Nagoudi AbdelRahim Elmadany Muhammad Abdul-Mageed 13 13 0 27 May 2022
HiJoNLP at SemEval-2022 Task 2: Detecting Idiomaticity of Multiword Expressions using Multilingual Pretrained Language Models Minghuan Tan 9 0 0 27 May 2022
Low Resource Style Transfer via Domain Adaptive Meta Learning Xiangyang Li Xiang Long Yu Xia Sujian Li 19 10 0 25 May 2022
DivEMT: Neural Machine Translation Post-Editing Effort Across Typologically Diverse Languages Gabriele Sarti Arianna Bisazza Ana Guerberof Arenas Antonio Toral 38 7 0 24 May 2022
Principled Paraphrase Generation with Parallel Corpora Aitor Ormazabal Mikel Artetxe Aitor Soroa Etxabe Gorka Labaka Eneko Agirre 48 9 0 24 May 2022
Lack of Fluency is Hurting Your Translation Model J. Yoo Jaewoo Kang 23 0 0 24 May 2022
When does Parameter-Efficient Transfer Learning Work for Machine Translation? Ahmet Üstün Asa Cooper Stickland 47 7 0 23 May 2022
BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla Abhik Bhattacharjee Tahmid Hasan Wasi Uddin Ahmad Rifat Shahriyar AIMat LM&MA 44 28 0 23 May 2022
Retrieval-Augmented Multilingual Keyphrase Generation with Retriever-Generator Iterative Training Yifan Gao Qingyu Yin Zheng Li Rui Meng Tong Zhao Bing Yin Irwin King M. Lyu RALM 41 20 0 21 May 2022
Translating Hanja Historical Documents to Contemporary Korean and English Juhee Son Jiho Jin Haneul Yoo Jinyeong Bak Kyunghyun Cho Alice Oh 35 4 0 20 May 2022
Descartes: Generating Short Descriptions of Wikipedia Articles Marija Sakota Maxime Peyrard Robert West VLM 20 2 0 20 May 2022
Evaluation of Transfer Learning for Polish with a Text-to-Text Model Aleksandra Chrabrowa Lukasz Dragan Karol Grzegorczyk D. Kajtoch Mikołaj Koszowski Robert Mroczkowski Piotr Rybak 40 18 0 18 May 2022
OneAligner: Zero-shot Cross-lingual Transfer with One Rich-Resource Language Pair for Low-Resource Sentence Retrieval Tong Niu Kazuma Hashimoto Yingbo Zhou Caiming Xiong VLM 29 5 0 17 May 2022
SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representation Sameer Khurana Antoine Laurent James R. Glass 30 36 0 17 May 2022
Meta AI at Arabic Hate Speech 2022: MultiTask Learning with Self-Correction for Hate Speech Classification Badr AlKhamissi Mona T. Diab 54 14 0 16 May 2022
Improving Neural Machine Translation of Indigenous Languages with Multilingual Transfer Learning Wei-Rui Chen Muhammad Abdul-Mageed 19 7 0 14 May 2022
Controlling Translation Formality Using Pre-trained Multilingual Language Models Elijah Matthew Rippeth Sweta Agrawal Marine Carpuat AI4CE 55 15 0 13 May 2022
ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generation Long Phan H. Tran Hieu Duy Nguyen Trieu H. Trinh ViT 41 63 0 13 May 2022