Multilingual Denoising Pre-training for Neural Machine Translation

22 January 2020

Yinhan Liu

Jiatao Gu

Naman Goyal

Xian Li

Sergey Edunov

Luke Zettlemoyer

Papers citing "Multilingual Denoising Pre-training for Neural Machine Translation"

50 / 934 papers shown

Title
Generate & Rank: A Multi-task Framework for Math Word Problems Jianhao Shen Yichun Yin Lin Li Lifeng Shang Xin Jiang Ming Zhang Qun Liu AIMat 16 125 0 07 Sep 2021
Don't Go Far Off: An Empirical Study on Neural Poetry Translation Tuhin Chakrabarty Arkadiy Saakyan Smaranda Muresan 14 16 0 07 Sep 2021
Paraphrase Generation as Unsupervised Machine Translation Xiaofei Sun Yufei Tian Yuxian Meng Nanyun Peng Fei Wu Jiwei Li Chun Fan LRM 22 5 0 07 Sep 2021
IndicBART: A Pre-trained Model for Indic Natural Language Generation Raj Dabre Himani Shrotriya Anoop Kunchukuttan Ratish Puduppully Mitesh M. Khapra Pratyush Kumar 47 70 0 07 Sep 2021
Text-to-Table: A New Way of Information Extraction Xueqing Wu Jiacheng Zhang Hang Li LMTD 30 54 0 06 Sep 2021
Finetuned Language Models Are Zero-Shot Learners Jason W. Wei Maarten Bosma Vincent Zhao Kelvin Guu Adams Wei Yu Brian Lester Nan Du Andrew M. Dai Quoc V. Le ALM UQCV 35 3,590 0 03 Sep 2021
Cross-Lingual Training with Dense Retrieval for Document Retrieval Peng Shi Rui Zhang Richard He Bai Jimmy J. Lin RALM 17 6 0 03 Sep 2021
Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding Yingmei Guo Linjun Shou J. Pei Ming Gong Mingxing Xu Zhiyong Wu Daxin Jiang 32 5 0 03 Sep 2021
MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfer Ilias Chalkidis Manos Fergadiotis Ion Androutsopoulos AILaw 27 107 0 02 Sep 2021
Survey of Low-Resource Machine Translation Barry Haddow Rachel Bawden Antonio Valerio Miceli Barone Jindvrich Helcl Alexandra Birch AIMat 39 150 0 01 Sep 2021
An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languages Xinyu Lu Jipeng Qiang Yun Li Yunhao Yuan Yi Zhu 33 19 0 01 Sep 2021
MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER Ran Zhou Xin Li Ruidan He Lidong Bing Min Zhang Luo Si Steven C. H. Hoi 34 95 0 31 Aug 2021
AraT5: Text-to-Text Transformers for Arabic Language Generation El Moatez Billah Nagoudi AbdelRahim Elmadany Muhammad Abdul-Mageed 92 118 0 31 Aug 2021
Student Surpasses Teacher: Imitation Attack for Black-Box NLP APIs Qiongkai Xu Xuanli He Lingjuan Lyu Lizhen Qu Gholamreza Haffari MLAU 40 22 0 29 Aug 2021
Code-switched inspired losses for generic spoken dialog representations E. Chapuis Pierre Colombo Matthieu Labeau Chloe Clave 27 12 0 27 Aug 2021
Subgoal Search For Complex Reasoning Tasks K. Czechowski Tomasz Odrzygó'zd'z Marek Zbysiñski Michał Zawalski Krzysztof Olejnik Yuhuai Wu Lukasz Kuciñski Piotr Milo's ReLM LRM 34 35 0 25 Aug 2021
YANMTT: Yet Another Neural Machine Translation Toolkit Raj Dabre Eiichiro Sumita 33 13 0 25 Aug 2021
Are the Multilingual Models Better? Improving Czech Sentiment with Transformers Pavel Přibáň J. Steinberger 36 11 0 24 Aug 2021
Deep Adversarially-Enhanced k-Nearest Neighbors Ren Wang Tianqi Chen Alfred Hero 27 0 0 15 Aug 2021
MTG: A Benchmark Suite for Multilingual Text Generation Yiran Chen Zhenqiao Song Xianze Wu Danqing Wang Jingjing Xu Jiaze Chen Hao Zhou Lei Li LRM VLM 40 22 0 13 Aug 2021
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha VLM LM&MA 26 261 0 12 Aug 2021
Machine Translation of Low-Resource Indo-European Languages Wei-Rui Chen Muhammad Abdul-Mageed 22 3 0 08 Aug 2021
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining Machel Reid Mikel Artetxe VLM 50 26 0 04 Aug 2021
Towards Universality in Multilingual Text Rewriting Xavier Garcia Noah Constant Mandy Guo Orhan Firat LRM 36 10 0 30 Jul 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 68 3,853 0 28 Jul 2021
Cross-lingual Transferring of Pre-trained Contextualized Language Models Zuchao Li Kevin Parnow Hai Zhao Zhuosheng Zhang Rui Wang Masao Utiyama Eiichiro Sumita 13 8 0 27 Jul 2021
One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval Akari Asai Xinyan Velocity Yu Jungo Kasai Hannaneh Hajishirzi RALM LRM 27 70 0 26 Jul 2021
The USYD-JD Speech Translation System for IWSLT 2021 Liang Ding Di Wu Dacheng Tao 37 16 0 24 Jul 2021
Integrating Unsupervised Data Generation into Self-Supervised Neural Machine Translation for Low-Resource Languages Dana Ruiter Dietrich Klakow Josef van Genabith C. España-Bonet 31 9 0 19 Jul 2021
Generative Pretraining for Paraphrase Evaluation J. Weston R. Lenain U. Meepegama E. Fristed AIMat 27 10 0 17 Jul 2021
On the Copying Behaviors of Pre-Training for Neural Machine Translation Xuebo Liu Longyue Wang Derek F. Wong Liang Ding Lidia S. Chao Shuming Shi Zhaopeng Tu 27 25 0 17 Jul 2021
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task Yun Tang Hongyu Gong Xian Li Changhan Wang J. Pino Holger Schwenk Naman Goyal 42 10 0 14 Jul 2021
From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text Ishan Tarunesh Syamantak Kumar P. Jyothi 44 45 0 14 Jul 2021
On the Difficulty of Translating Free-Order Case-Marking Languages Arianna Bisazza Ahmet Üstün Stephan Sportel 36 9 0 13 Jul 2021
A Survey on Low-Resource Neural Machine Translation Rui Wang Xu Tan Renqian Luo Tao Qin Tie-Yan Liu 3DV 38 58 0 09 Jul 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 43 74 0 01 Jul 2021
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA Zewen Chi Shaohan Huang Li Dong Shuming Ma Bo Zheng ... Payal Bajaj Xia Song Xian-Ling Mao Heyan Huang Furu Wei 53 118 0 30 Jun 2021
On Systematic Style Differences between Unsupervised and Supervised MT and an Application for High-Resource Machine Translation Kelly Marchisio Markus Freitag David Grangier 22 4 0 30 Jun 2021
Neural Machine Translation for Low-Resource Languages: A Survey Surangika Ranathunga E. Lee Marjana Prifti Skenduli Ravi Shekhar Mehreen Alam Rishemjit Kaur 40 236 0 29 Jun 2021
DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders Shuming Ma Li Dong Shaohan Huang Dongdong Zhang Alexandre Muzio Saksham Singhal Hany Awadalla Xia Song Furu Wei SLR AI4CE 25 80 0 25 Jun 2021
Language Models are Good Translators Shuo Wang Zhaopeng Tu Zhixing Tan Wenxuan Wang Maosong Sun Yang Liu 29 21 0 25 Jun 2021
Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling Hongyu Gong Yun Tang J. Pino Xian Li 33 11 0 21 Jun 2021
Language Tags Matter for Zero-Shot Neural Machine Translation Liwei Wu Shanbo Cheng Mingxuan Wang Lei Li 3DV 45 36 0 15 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 58 816 0 14 Jun 2021
Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning Bill Yuchen Lin Seyeon Lee Xiaoyang Qiao Xiang Ren ReLM LRM 27 61 0 13 Jun 2021
Don't Rule Out Monolingual Speakers: A Method For Crowdsourcing Machine Translation Data Rajat Bhatnagar Ananya Ganesh Katharina Kann 21 2 0 12 Jun 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 45 67 0 11 Jun 2021
Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation Xin Liu Baosong Yang Dayiheng Liu Haibo Zhang Weihua Luo Min Zhang Haiying Zhang Jinsong Su 18 18 0 11 Jun 2021
Exploring Unsupervised Pretraining Objectives for Machine Translation Christos Baziotis Ivan Titov Alexandra Birch Barry Haddow AAML AI4CE 34 7 0 10 Jun 2021
Learning Multilingual Representation for Natural Language Understanding with Enhanced Cross-Lingual Supervision Yinpeng Guo Liangyou Li Xin Jiang Qun Liu 27 0 0 09 Jun 2021