Multilingual Denoising Pre-training for Neural Machine Translation

22 January 2020

Yinhan Liu

Jiatao Gu

Naman Goyal

Xian Li

Sergey Edunov

Luke Zettlemoyer

Papers citing "Multilingual Denoising Pre-training for Neural Machine Translation"

50 / 933 papers shown

Title
Crosslingual Embeddings are Essential in UNMT for Distant Languages: An English to IndoAryan Case Study Tamali Banerjee V. Rudra Murthy P. Bhattacharyya 32 9 0 09 Jun 2021
Making Better Use of Bilingual Information for Cross-Lingual AMR Parsing Yitao Cai Zhe-nan Lin Xiaojun Wan 18 2 0 09 Jun 2021
Self-supervised and Supervised Joint Training for Resource-rich Machine Translation Yong Cheng Wei Wang Lu Jiang Wolfgang Macherey 23 17 0 08 Jun 2021
Investigating Transfer Learning in Multilingual Pre-trained Language Models through Chinese Natural Language Inference Hai Hu He Zhou Zuoyu Tian Yiwen Zhang Yina Ma Yanting Li Yixin Nie Kyle Richardson 27 11 0 07 Jun 2021
Combining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Induction Jinpeng Zhang Baijun Ji Nini Xiao Xiangyu Duan Min Zhang Yangbin Shi Weihua Luo 34 22 0 06 Jun 2021
BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling Zhaojiang Lin Andrea Madotto Genta Indra Winata Peng Xu Feijun Jiang Yuxiang Hu Chen Shi Pascale Fung 27 61 0 05 Jun 2021
nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models? Mihir Kale Aditya Siddhant Noah Constant Melvin Johnson Rami Al-Rfou Linting Xue LRM 29 25 0 03 Jun 2021
A Dataset and Baselines for Multilingual Reply Suggestion Mozhi Zhang Wei Wang Budhaditya Deb Guoqing Zheng Milad Shokouhi Ahmed Hassan Awadallah LRM 17 8 0 03 Jun 2021
ZmBART: An Unsupervised Cross-lingual Transfer Framework for Language Generation Kaushal Kumar Maurya M. Desarkar Yoshinobu Kano K. Deepshikha 16 38 0 03 Jun 2021
Lightweight Adapter Tuning for Multilingual Speech Translation Hang Le J. Pino Changhan Wang Jiatao Gu D. Schwab Laurent Besacier 21 88 0 02 Jun 2021
Self-Training Sampling with Monolingual Data Uncertainty for Neural Machine Translation Wenxiang Jiao Xing Wang Zhaopeng Tu Shuming Shi M. Lyu Irwin King UQLM 10 35 0 02 Jun 2021
ViTA: Visual-Linguistic Translation by Aligning Object Tags Kshitij Gupta Devansh Gautam R. Mamidi 12 14 0 01 Jun 2021
Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data Wei-Jen Ko Ahmed El-Kishky Adithya Renduchintala Vishrav Chaudhary Naman Goyal Francisco Guzmán Pascale Fung Philipp Koehn Mona T. Diab 19 40 0 31 May 2021
Transfer Learning for Sequence Generation: from Single-source to Multi-source Xuancheng Huang Jingfang Xu Maosong Sun Yang Liu 27 5 0 31 May 2021
G-Transformer for Document-level Machine Translation Guangsheng Bao Yue Zhang Zhiyang Teng Boxing Chen Weihua Luo 19 78 0 31 May 2021
Fast Nearest Neighbor Machine Translation Yuxian Meng Xiaoya Li Xiayu Zheng Fei Wu Xiaofei Sun Tianwei Zhang Jiwei Li LRM 19 49 0 30 May 2021
Investigating Code-Mixed Modern Standard Arabic-Egyptian to English Machine Translation El Moatez Billah Nagoudi AbdelRahim Elmadany Muhammad Abdul-Mageed MoE 22 11 0 28 May 2021
Contrastive Learning for Many-to-many Multilingual Neural Machine Translation Xiao Pan Mingxuan Wang Liwei Wu Lei Li 18 200 0 20 May 2021
Learning Language Specific Sub-network for Multilingual Machine Translation Zehui Lin Liwei Wu Mingxuan Wang Lei Li 24 81 0 19 May 2021
Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixing Ganesh Jawahar El Moatez Billah Nagoudi Muhammad Abdul-Mageed L. Lakshmanan 23 29 0 18 May 2021
End-to-End Speech Translation with Pre-trained Models and Adapters: UPC at IWSLT 2021 Gerard I. Gállego Ioannis Tsiamas Carlos Escolano José A. R. Fonollosa Marta R. Costa-jussá 25 30 0 10 May 2021
Continual Mixed-Language Pre-Training for Extremely Low-Resource Neural Machine Translation Zihan Liu Genta Indra Winata Pascale Fung VLM CLL 37 49 0 09 May 2021
Generalising Multilingual Concept-to-Text NLG with Language Agnostic Delexicalisation Giulio Zhou Gerasimos Lampouras 11 3 0 07 May 2021
Paraphrastic Representations at Scale John Wieting Kevin Gimpel Graham Neubig Taylor Berg-Kirkpatrick 19 19 0 30 Apr 2021
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding Yiheng Xu Tengchao Lv Lei Cui Guoxin Wang Yijuan Lu D. Florêncio Cha Zhang Furu Wei MLLM VLM 38 127 0 18 Apr 2021
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation Mozhdeh Gheini Xiang Ren Jonathan May LRM 22 105 0 18 Apr 2021
Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders Guanhua Chen Shuming Ma Yun-Nung Chen Li Dong Dongdong Zhang Jianxiong Pan Wenping Wang Furu Wei 30 39 0 18 Apr 2021
MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs Zewen Chi Li Dong Shuming Ma Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei LRM 50 72 0 18 Apr 2021
Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems E. Razumovskaia Goran Glavavs Olga Majewska E. Ponti Anna Korhonen Ivan Vulić 23 32 0 17 Apr 2021
"Wikily" Supervised Neural Translation Tailored to Cross-Lingual Tasks Mohammad Sadegh Rasooli Chris Callison-Burch Derry Wijaya CLIP 26 5 0 16 Apr 2021
ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation Weizhen Qi Yeyun Gong Yu Yan Can Xu Bolun Yao ... Daxin Jiang Jiusheng Chen Ruofei Zhang Houqiang Li Nan Duan 26 51 0 16 Apr 2021
Hierarchical Learning for Generation with Long Source Sequences T. Rohde Xiaoxia Wu Yinhan Liu BDL VLM 25 56 0 15 Apr 2021
Adaptive Sparse Transformer for Multilingual Translation Hongyu Gong Xian Li Dmitriy Genzel 20 14 0 15 Apr 2021
Macro-Average: Rare Types Are Important Too Thamme Gowda Weiqiu You Constantine Lignos Jonathan May 14 25 0 12 Apr 2021
Robust Experimentation in the Continuous Time Bandit Problem Pasquale Antonante 25 12 0 31 Mar 2021
Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translation Tao Wang Chengqi Zhao Mingxuan Wang Lei Li Deyi Xiong 28 13 0 30 Mar 2021
Unsupervised Machine Translation On Dravidian Languages Sai Koneru Danni Liu Jan Niehues 42 7 0 29 Mar 2021
Low-Resource Machine Translation Training Curriculum Fit for Low-Resource Languages Garry Kuwanto Afra Feyza Akyürek Isidora Chara Tourni Siyang Li Alex Jones Derry Wijaya 27 5 0 24 Mar 2021
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures Sushant Singh A. Mahmood AI4TS 60 92 0 23 Mar 2021
Multilingual Autoregressive Entity Linking Nicola De Cao Ledell Yu Wu Kashyap Popat Mikel Artetxe Naman Goyal Mikhail Plekhanov Luke Zettlemoyer Nicola Cancedda Sebastian Riedel Fabio Petroni LRM 20 87 0 23 Mar 2021
Let Your Heart Speak in its Mother Tongue: Multilingual Captioning of Cardiac Signals Dani Kiyasseh T. Zhu David A. Clifton 27 0 0 19 Mar 2021
Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution Xavier Garcia Noah Constant Ankur P. Parikh Orhan Firat 48 42 0 11 Mar 2021
Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddings Linlin Liu Thien Hai Nguyen Chenyu You Lidong Bing Luo Si 41 5 0 11 Mar 2021
Unified Pre-training for Program Understanding and Generation Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang 23 748 0 10 Mar 2021
RuSentEval: Linguistic Source, Encoder Force! Vladislav Mikhailov Ekaterina Taktasheva Elina Sigdel Ekaterina Artemova VLM 19 6 0 28 Feb 2021
Revisiting Language Encoding in Learning Multilingual Representations Shengjie Luo Kaiyuan Gao Shuxin Zheng Guolin Ke Di He Liwei Wang Tie-Yan Liu 31 2 0 16 Feb 2021
MAPGN: MAsked Pointer-Generator Network for sequence-to-sequence pre-training Mana Ihori Naoki Makishima Tomohiro Tanaka Akihiko Takashima Shota Orihashi Ryo Masumura SSL 25 5 0 15 Feb 2021
InsNet: An Efficient, Flexible, and Performant Insertion-based Text Generation Model Sidi Lu Tao Meng Nanyun Peng 16 12 0 12 Feb 2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann Tosin P. Adewumi Karmanya Aggarwal Pawan Sasanka Ammanamanchi Aremu Anuoluwapo ... Nishant Subramani Wei-ping Xu Diyi Yang Akhila Yerukola Jiawei Zhou VLM 260 285 0 02 Feb 2021
An Empirical Study of Cross-Lingual Transferability in Generative Dialogue State Tracker Yen-Ting Lin Yun-Nung Chen 27 4 0 27 Jan 2021