Multilingual Denoising Pre-training for Neural Machine Translation

22 January 2020

Yinhan Liu

Jiatao Gu

Naman Goyal

Xian Li

Sergey Edunov

Luke Zettlemoyer

Papers citing "Multilingual Denoising Pre-training for Neural Machine Translation"

50 / 934 papers shown

Title
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 83 83 0 08 Nov 2021
Contextual Semantic Parsing for Multilingual Task-Oriented Dialogues M. Moradshahi Victoria Tsai Giovanni Campagna M. Lam 14 16 0 04 Nov 2021
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task Jian Yang Shuming Ma Haoyang Huang Dongdong Zhang Li Dong ... Alexandre Muzio Saksham Singhal Hany Awadalla Xia Song Furu Wei 35 45 0 03 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 83 1,038 0 01 Nov 2021
Empirical Analysis of Korean Public AI Hub Parallel Corpora and in-depth Analysis using LIWC Chanjun Park Midan Shim Sugyeong Eo Seolhwa Lee Jaehyung Seo Hyeonseok Moon Heuiseok Lim 21 8 0 28 Oct 2021
PhoMT: A High-Quality and Large-Scale Benchmark Dataset for Vietnamese-English Machine Translation Long Doan L. T. Nguyen Nguyen Luong Tran T. Hoang Dat Quoc Nguyen 33 22 0 23 Oct 2021
Multilingual Unsupervised Neural Machine Translation with Denoising Adapters Ahmet Üstün Alexandre Berard Laurent Besacier Matthias Gallé 25 44 0 20 Oct 2021
Discontinuous Grammar as a Foreign Language Daniel Fernández-González Carlos Gómez-Rodríguez 50 9 0 20 Oct 2021
Multilingual Domain Adaptation for NMT: Decoupling Language and Domain Information with Adapters Asa Cooper Stickland Alexandre Berard Vassilina Nikoulina AI4CE 19 28 0 18 Oct 2021
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metricsfor Automatic Text Generation Moussa Kamal Eddine Guokan Shang A. Tixier Michalis Vazirgiannis 26 25 0 16 Oct 2021
Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translation Guanhua Chen Shuming Ma Yun-Nung Chen Dongdong Zhang Jia-Yu Pan Wenping Wang Furu Wei LRM 31 14 0 16 Oct 2021
Substructure Distribution Projection for Zero-Shot Cross-Lingual Dependency Parsing Freda Shi Kevin Gimpel Karen Livescu 147 7 0 16 Oct 2021
Prix-LM: Pretraining for Multilingual Knowledge Base Construction Wenxuan Zhou Fangyu Liu Ivan Vulić Nigel Collier Muhao Chen KELM 72 18 0 16 Oct 2021
Multilingual unsupervised sequence segmentation transfers to extremely low-resource languages C.M. Downey Shannon Drizin Levon Haroutunian Shivin Thukral 31 2 0 16 Oct 2021
DS-TOD: Efficient Domain Specialization for Task Oriented Dialog Chia-Chien Hung Anne Lauscher Simone Paolo Ponzetto Goran Glavaš 39 31 0 15 Oct 2021
mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka 31 30 0 15 Oct 2021
Unifying Cross-lingual Summarization and Machine Translation with Compression Rate Yu Bai Heyan Huang Kai Fan Yang Gao Yi-Bo Zhu Jiaao Zhan Zewen Chi Boxing Chen 30 9 0 15 Oct 2021
GlobalWoZ: Globalizing MultiWoZ to Develop Multilingual Task-Oriented Dialogue Systems Bosheng Ding Junjie Hu Lidong Bing Sharifah Aljunied Mahani Shafiq Joty Luo Si Chunyan Miao 50 41 0 14 Oct 2021
Transferring Semantic Knowledge Into Language Encoders Mohammad Umair Francis Ferraro 22 1 0 14 Oct 2021
Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation Benjamin Muller Luca Soldaini Rik Koncel-Kedziorski Eric Lind Alessandro Moschitti LRM 38 8 0 14 Oct 2021
SportsSum2.0: Generating High-Quality Sports News from Live Text Commentary Jiaan Wang Zhixu Li Qiang Yang Jianfeng Qu Zhigang Chen Qingsheng Liu Guoping Hu AI4TS 17 6 0 12 Oct 2021
Unsupervised Neural Machine Translation with Generative Language Models Only Jesse Michael Han Igor Babuschkin Harrison Edwards Arvind Neelakantan Tao Xu ... Alex Ray Pranav Shyam Aditya A. Ramesh Alec Radford Ilya Sutskever 52 36 0 11 Oct 2021
Towards a Unified View of Parameter-Efficient Transfer Learning Junxian He Chunting Zhou Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig AAML 62 894 0 08 Oct 2021
VieSum: How Robust Are Transformer-based Models on Vietnamese Summarization? Hieu Duy Nguyen Long Phan J. Anibal Alec Peltekian H. Tran 19 5 0 08 Oct 2021
Pretrained Language Models are Symbolic Mathematics Solvers too! Kimia Noorbakhsh Modar Sulaiman M. Sharifi Kallol Roy Pooyan Jamshidi LRM 28 18 0 07 Oct 2021
Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learning Seanie Lee Haebeom Lee Juho Lee Sung Ju Hwang MoMe CLL 53 17 0 06 Oct 2021
On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translation Xuebo Liu Longyue Wang Derek F. Wong Liang Ding Lidia S. Chao Shuming Shi Zhaopeng Tu 35 26 0 05 Oct 2021
Multilingual AMR Parsing with Noisy Knowledge Distillation Deng Cai Xin Li Jackie Chun-Sing Ho Lidong Bing W. Lam 27 18 0 30 Sep 2021
Call Larisa Ivanovna: Code-Switching Fools Multilingual NLU Models Alexey Birshert Ekaterina Artemova 45 2 0 29 Sep 2021
Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbations Ekaterina Taktasheva Vladislav Mikhailov Ekaterina Artemova 24 13 0 28 Sep 2021
On Isotropy Calibration of Transformers Yue Ding Karolis Martinkus Damian Pascual Simon Clematide Roger Wattenhofer 19 1 0 27 Sep 2021
PicTalky: Augmentative and Alternative Communication Software for Language Developmental Disabilities Chanjun Park Yoonna Jang Seolhwa Lee Jaehyung Seo Kisu Yang Heuiseok Lim 13 6 0 27 Sep 2021
Unsupervised Translation of German--Lower Sorbian: Exploring Training and Novel Transfer Methods on a Low-Resource Language Lukas Edman Ahmet Üstün Antonio Toral Gertjan van Noord 15 6 0 24 Sep 2021
Exploiting Curriculum Learning in Unsupervised Neural Machine Translation Jinliang Lu Jiajun Zhang 29 7 0 23 Sep 2021
Cross-Lingual Language Model Meta-Pretraining Zewen Chi Heyan Huang Luyang Liu Yu Bai Xian-Ling Mao LRM 103 0 0 23 Sep 2021
Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languages Tejas I. Dhamecha V. Rudramurthy Samarth Bharadwaj Karthik Sankaranarayanan P. Bhattacharyya 45 25 0 22 Sep 2021
Scalable and Efficient MoE Training for Multitask Multilingual Models Young Jin Kim A. A. Awan Alexandre Muzio Andres Felipe Cruz Salinas Liyang Lu Amr Hendy Samyam Rajbhandari Yuxiong He Hany Awadalla MoE 104 84 0 22 Sep 2021
BARTpho: Pre-trained Sequence-to-Sequence Models for Vietnamese Nguyen Luong Tran Duong Minh Le Dat Quoc Nguyen 19 52 0 20 Sep 2021
DuRecDial 2.0: A Bilingual Parallel Corpus for Conversational Recommendation Zeming Liu Haifeng Wang Zheng-Yu Niu Hua Wu Wanxiang Che 23 56 0 18 Sep 2021
Improving Neural Machine Translation by Bidirectional Training Liang Ding Di Wu Dacheng Tao 29 30 0 16 Sep 2021
Language Models are Few-shot Multilingual Learners Genta Indra Winata Andrea Madotto Zhaojiang Lin Rosanne Liu J. Yosinski Pascale Fung ELM LRM 38 132 0 16 Sep 2021
Miðeind's WMT 2021 submission Haukur Barri Símonarson Vésteinn Snæbjarnarson Pétur Orri Ragnarsson Haukur Páll Jónsson Vilhjálmur Þorsteinsson VLM 31 11 0 15 Sep 2021
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation Yunfan Shao Zhichao Geng Yitao Liu Junqi Dai Hang Yan Fei Yang Li Zhe Hujun Bao Xipeng Qiu MedIm 70 149 0 13 Sep 2021
Multilingual Translation via Grafting Pre-trained Language Models Zewei Sun Mingxuan Wang Lei Li AI4CE 191 22 0 11 Sep 2021
Empirical Analysis of Training Strategies of Transformer-based Japanese Chit-chat Systems Hiroaki Sugiyama M. Mizukami Tsunehiro Arimoto Hiromi Narimatsu Yuya Chiba Hideharu Nakajima Toyomi Meguro 129 49 0 11 Sep 2021
AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languages Machel Reid Junjie Hu Graham Neubig Y. Matsuo 77 31 0 10 Sep 2021
Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variables Weizhi Wang Zhirui Zhang Yichao Du Boxing Chen Jun Xie Weihua Luo 37 20 0 10 Sep 2021
Subword Mapping and Anchoring across Languages Giorgos Vernikos Andrei Popescu-Belis 70 12 0 09 Sep 2021
Competence-based Curriculum Learning for Multilingual Machine Translation Mingliang Zhang Fandong Meng Y. Tong Jie Zhou 39 16 0 09 Sep 2021
Collecting a Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation Shahar Levy Koren Lazar Gabriel Stanovsky 34 64 0 08 Sep 2021