Multilingual Denoising Pre-training for Neural Machine Translation

22 January 2020

Yinhan Liu

Jiatao Gu

Naman Goyal

Xian Li

Sergey Edunov

Luke Zettlemoyer

Papers citing "Multilingual Denoising Pre-training for Neural Machine Translation"

50 / 933 papers shown

Title
A Comparison of Approaches to Document-level Machine Translation Zhiyi Ma Sergey Edunov Michael Auli 15 13 0 26 Jan 2021
El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsing Arash Einolghozati Abhinav Arora Lorena Sainz-Maza Lecanda Anuj Kumar Sonal Gupta 35 9 0 26 Jan 2021
Efficiently Fusing Pretrained Acoustic and Linguistic Encoders for Low-resource Speech Recognition Cheng Yi Shiyu Zhou Bo Xu 51 40 0 17 Jan 2021
Prefix-Tuning: Optimizing Continuous Prompts for Generation Xiang Lisa Li Percy Liang 20 4,088 0 01 Jan 2021
Graphmax for Text Generation Bin Liu Guosheng Yin 22 1 0 01 Jan 2021
Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignment Freda Shi Luke Zettlemoyer Sida I. Wang SSL 24 32 0 01 Jan 2021
ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora Ouyang Xuan Shuohuan Wang Chao Pang Yu Sun Hao Tian Hua Wu Haifeng Wang 62 100 0 31 Dec 2020
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders Shuming Ma Jian Yang Haoyang Huang Zewen Chi Li Dong ... Akiko Eriguchi Saksham Singhal Xia Song Arul Menezes Furu Wei LRM 26 33 0 31 Dec 2020
Neural Machine Translation: A Review of Methods, Resources, and Tools Zhixing Tan Shuo Wang Zonghan Yang Gang Chen Xuancheng Huang Maosong Sun Yang Liu 3DV AI4TS 17 105 0 31 Dec 2020
CLEAR: Contrastive Learning for Sentence Representation Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun Hao Ma SSL 33 319 0 31 Dec 2020
Leveraging ParsBERT and Pretrained mT5 for Persian Abstractive Text Summarization Mehrdad Farahani Mohammad Gharachorloo Mohammad Manthouri 17 23 0 21 Dec 2020
Multilingual Evidence Retrieval and Fact Verification to Combat Global Disinformation: The Power of Polyglotism Denisa A.O. Roberts 43 3 0 16 Dec 2020
As Good as New. How to Successfully Recycle English GPT-2 to Make Models for Other Languages Wietse de Vries Malvina Nissim 25 75 0 10 Dec 2020
Globetrotter: Connecting Languages by Connecting Images Dídac Surís Dave Epstein Carl Vondrick VLM 8 9 0 08 Dec 2020
Facebook AI's WMT20 News Translation Task Submission Peng-Jen Chen Ann Lee Changhan Wang Naman Goyal Angela Fan Mary Williamson Jiatao Gu VLM 17 37 0 16 Nov 2020
Score Combination for Improved Parallel Corpus Filtering for Low Resource Conditions Muhammad N. ElNokrashy Amr Hendy M. Abdelghaffar Mohamed Afify Ahmed Tawfik Hany Awadalla 16 3 0 16 Nov 2020
Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling Shruti Bhosale Kyra Yee Sergey Edunov Michael Auli 50 7 0 13 Nov 2020
Positional Artefacts Propagate Through Masked Language Model Embeddings Ziyang Luo Artur Kulmizev Xiaoxi Mao 29 41 0 09 Nov 2020
Best Practices for Data-Efficient Modeling in NLG:How to Train Production-Ready Neural Models with Less Data A. Arun Soumya Batra Vikas Bhardwaj Ashwini Challa Pinar E. Donmez ... Shashank Jain Anuj Kumar Shawn Mei Karthika Mohan Michael White 12 10 0 08 Nov 2020
Detecting Hallucinated Content in Conditional Neural Sequence Generation Chunting Zhou Graham Neubig Jiatao Gu Mona T. Diab P. Guzmán Luke Zettlemoyer Marjan Ghazvininejad HILM 39 195 0 05 Nov 2020
Emergent Communication Pretraining for Few-Shot Machine Translation Yaoyiran Li E. Ponti Ivan Vulić Anna Korhonen 25 19 0 02 Nov 2020
Context-Aware Cross-Attention for Non-Autoregressive Translation Liang Ding Longyue Wang Di Wu Dacheng Tao Zhaopeng Tu 10 40 0 02 Nov 2020
A Targeted Attack on Black-Box Neural Machine Translation with Parallel Data Poisoning Chang Xu Jun Wang Yuqing Tang Francisco Guzman Benjamin I. P. Rubinstein Trevor Cohn AAML 20 7 0 02 Nov 2020
VECO: Variable and Flexible Cross-lingual Pre-training for Language Understanding and Generation Fuli Luo Wei Wang Jiahao Liu Yijia Liu Bin Bi Songfang Huang Fei Huang Luo Si 34 51 0 30 Oct 2020
Pre-trained Summarization Distillation Sam Shleifer Alexander M. Rush 26 98 0 24 Oct 2020
Multilingual Speech Translation with Efficient Finetuning of Pretrained Models Xian Li Changhan Wang Yun Tang C. Tran Yuqing Tang J. Pino Alexei Baevski Alexis Conneau Michael Auli 21 6 0 24 Oct 2020
Rapid Domain Adaptation for Machine Translation with Monolingual Data Mahdis Mahdieh Mengzhao Chen Yuan Cao Orhan Firat 45 7 0 23 Oct 2020
BARThez: a Skilled Pretrained French Sequence-to-Sequence Model Moussa Kamal Eddine A. Tixier Michalis Vazirgiannis BDL 103 64 0 23 Oct 2020
Towards Zero-Shot Multilingual Synthetic Question and Answer Generation for Cross-Lingual Reading Comprehension Siamak Shakeri Noah Constant Mihir Kale Linting Xue SyDa 21 28 0 22 Oct 2020
mT5: A massively multilingual pre-trained text-to-text transformer Linting Xue Noah Constant Adam Roberts Mihir Kale Rami Al-Rfou Aditya Siddhant Aditya Barua Colin Raffel 31 2,445 0 22 Oct 2020
Beyond English-Centric Multilingual Machine Translation Angela Fan Shruti Bhosale Holger Schwenk Zhiyi Ma Ahmed El-Kishky ... Vitaliy Liptchinsky Sergey Edunov Edouard Grave Michael Auli Armand Joulin LRM 38 826 0 21 Oct 2020
Revisiting Modularized Multilingual NMT to Meet Industrial Demands Sungwon Lyu Bokyung Son Kichang Yang Jaekyoung Bae MoE 15 20 0 19 Oct 2020
Rethinking Document-level Neural Machine Translation Zewei Sun Mingxuan Wang Hao Zhou Chengqi Zhao Shujian Huang Jiajun Chen Lei Li VLM 83 47 0 18 Oct 2020
Mixed-Lingual Pre-training for Cross-lingual Summarization Ruochen Xu Chenguang Zhu Yu Shi Michael Zeng Xuedong Huang 22 26 0 18 Oct 2020
Towards Machine Translation for the Kurdish Language Sina Ahmadi Mariam Masoud 19 13 0 12 Oct 2020
Multi-Stage Pre-training for Low-Resource Domain Adaptation Rong Zhang Revanth Reddy Gangi Reddy Md Arafat Sultan Vittorio Castelli Anthony Ferritto Radu Florian Efsun Sarioglu Kayi Salim Roukos Avirup Sil T. Ward 16 42 0 12 Oct 2020
Localizing Open-Ontology QA Semantic Parsers in a Day Using Machine Translation M. Moradshahi Giovanni Campagna Sina J. Semnani Silei Xu M. Lam 11 1 0 10 Oct 2020
Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification using Pre-trained Language Models Shuohuan Wang Jiaxiang Liu Ouyang Xuan Yu Sun 34 36 0 07 Oct 2020
Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information Zehui Lin Xiao Pan Mingxuan Wang Xipeng Qiu Jiangtao Feng Hao Zhou Lei Li 10 125 0 07 Oct 2020
WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization Faisal Ladhak Esin Durmus Claire Cardie Kathleen McKeown CVBM 12 196 0 07 Oct 2020
On the Sparsity of Neural Machine Translation Models Yong Wang Longyue Wang V. Li Zhaopeng Tu MoE 12 11 0 06 Oct 2020
Multi-task Learning for Multilingual Neural Machine Translation Yiren Wang Chengxiang Zhai Hany Awadalla 37 68 0 06 Oct 2020
Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages W. Nekoto Vukosi Marivate T. Matsila Timi E. Fasubaa T. Kolawole ... A. Olabiyi A. Ramkilowan A. Oktem Adewale Akinfaderin Abdallah Bashir 26 198 0 05 Oct 2020
Which *BERT? A Survey Organizing Contextualized Encoders Patrick Xia Shijie Wu Benjamin Van Durme 26 50 0 02 Oct 2020
STIL -- Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++ Jack G. M. FitzGerald 19 13 0 02 Oct 2020
Deep Transformers with Latent Depth Xian Li Asa Cooper Stickland Yuqing Tang X. Kong 21 22 0 28 Sep 2020
Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages Xavier Garcia Aditya Siddhant Orhan Firat Ankur P. Parikh 30 31 0 23 Sep 2020
Unsupervised Parallel Corpus Mining on Web Data Guokun Lai Zihang Dai Yiming Yang 9 8 0 18 Sep 2020
Code-switching pre-training for neural machine translation Zhen Yang Bojie Hu Ambyera Han Shen Huang Qi Ju 24 71 0 17 Sep 2020
Global-aware Beam Search for Neural Abstractive Summarization Ye Ma Zixun Lan Lu Zong Kaizhu Huang 28 12 0 15 Sep 2020