Multilingual Denoising Pre-training for Neural Machine Translation

22 January 2020

Yinhan Liu

Jiatao Gu

Naman Goyal

Xian Li

Sergey Edunov

Luke Zettlemoyer

Papers citing "Multilingual Denoising Pre-training for Neural Machine Translation"

50 / 935 papers shown

Title
When Does Monolingual Data Help Multilingual Translation: The Role of Domain and Model Scale Christos Baziotis Biao Zhang Alexandra Birch Barry Haddow 37 2 0 23 May 2023
Improving speech translation by fusing speech and text Wenbiao Yin Zhicheng Liu Chengqi Zhao Tao Wang Jian-Fei Tong Rong Ye 15 4 0 23 May 2023
Sāmayik: A Benchmark and Dataset for English-Sanskrit Translation Ayush Maheshwari Ashim Gupta Amrith Krishna Atul Kumar Singh Ganesh Ramakrishnan G. Anil Kumar Jitin Singla 37 1 0 23 May 2023
Scaling Speech Technology to 1,000+ Languages Vineel Pratap Andros Tjandra Bowen Shi Paden Tomasello Arun Babu ... Yossi Adi Xiaohui Zhang Wei-Ning Hsu Alexis Conneau Michael Auli VLM 85 304 0 22 May 2023
Extrapolating Multilingual Understanding Models as Multilingual Generators Bohong Wu Fei Yuan Hai Zhao Lei Li Jingjing Xu AI4CE 27 2 0 22 May 2023
Language Models for German Text Simplification: Overcoming Parallel Data Scarcity through Style-specific Pre-training Miriam Anschütz Joshua Oehms Thomas Wimmer Bartlomiej Jezierski Georg Groh 32 22 0 22 May 2023
Non-Autoregressive Document-Level Machine Translation Guangsheng Bao Zhiyang Teng Hao Zhou Jianhao Yan Yue Zhang 44 0 0 22 May 2023
Gloss-Free End-to-End Sign Language Translation Kezhou Lin Xiaohan Wang Linchao Zhu Ke Sun Bang Zhang Yezhou Yang SLR 42 18 0 22 May 2023
Mitigating Data Imbalance and Representation Degeneration in Multilingual Machine Translation Wen Lai Alexandra Chronopoulou Alexander Fraser 40 5 0 22 May 2023
Duplex Diffusion Models Improve Speech-to-Speech Translation Xianchao Wu DiffM 25 4 0 22 May 2023
Machine Translation by Projecting Text into the Same Phonetic-Orthographic Space Using a Common Encoding Amit Kumar Shantipriya Parida A. Pratap Anil Kumar Singh 32 1 0 21 May 2023
Accurate Knowledge Distillation with n-best Reranking Hendra Setiawan 29 2 0 20 May 2023
Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment Tianshu Yu Haoyu Gao Ting-En Lin Min Yang Yuchuan Wu Wen-Cheng Ma Chao Wang Fei Huang Yongbin Li 27 19 0 19 May 2023
DUB: Discrete Unit Back-translation for Speech Translation Dong Zhang Rong Ye Tom Ko Mingxuan Wang Yaqian Zhou 31 23 0 19 May 2023
mLongT5: A Multilingual and Efficient Text-To-Text Transformer for Longer Sequences David C. Uthus Santiago Ontañón Joshua Ainslie Mandy Guo VLM 30 10 0 18 May 2023
Language Model Tokenizers Introduce Unfairness Between Languages Aleksandar Petrov Emanuele La Malfa Philip Torr Adel Bibi 52 98 0 17 May 2023
Variable-length Neural Interlingua Representations for Zero-shot Neural Machine Translation Zhuoyuan Mao Haiyue Song Raj Dabre Chenhui Chu Sadao Kurohashi 37 0 0 17 May 2023
The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translation Mutian He Philip N. Garner 46 4 0 16 May 2023
Exploring the Impact of Layer Normalization for Zero-shot Neural Machine Translation Zhuoyuan Mao Raj Dabre Qianying Liu Haiyue Song Chenhui Chu Sadao Kurohashi 19 7 0 16 May 2023
Towards Speech Dialogue Translation Mediating Speakers of Different Languages Shuichiro Shimizu Chenhui Chu Sheng Li Sadao Kurohashi Kyoto University 8 1 0 16 May 2023
PMIndiaSum: Multilingual and Cross-lingual Headline Summarization for Languages in India Ashok Urlana Pinzhen Chen Zheng Zhao Shay B. Cohen Manish Shrivastava Barry Haddow 42 9 0 15 May 2023
Measuring Cross-Lingual Transferability of Multilingual Transformers on Sentence Classification Zewen Chi Heyan Huang Xian-Ling Mao 76 0 0 15 May 2023
Prompt Learning to Mitigate Catastrophic Forgetting in Cross-lingual Transfer for Open-domain Dialogue Generation Lei Liu J. Huang CLL 31 2 0 12 May 2023
Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting Haoyang Huang Tianyi Tang Dongdong Zhang Wayne Xin Zhao Ting Song Yan Xia Furu Wei LRM 40 157 0 11 May 2023
WebCPM: Interactive Web Search for Chinese Long-form Question Answering Yujia Qin Zihan Cai Di Jin Lan Yan Shi Liang ... Ruobing Xie Fanchao Qi Zhiyuan Liu Maosong Sun Jie Zhou RALM 25 87 0 11 May 2023
Chain-of-Dictionary Prompting Elicits Translation in Large Language Models Hongyuan Lu Haoran Yang Haoyang Huang Dongdong Zhang Wai Lam Furu Wei LRM AI4CE 40 15 0 11 May 2023
Multilingual LLMs are Better Cross-lingual In-context Learners with Alignment Eshaan Tanwar Subhabrata Dutta Manish Borthakur Tanmoy Chakraborty 32 52 0 10 May 2023
CharSpan: Utilizing Lexical Similarity to Enable Zero-Shot Machine Translation for Extremely Low-resource Languages Kaushal Kumar Maurya Rahul Kejriwal M. Desarkar Anoop Kunchukuttan 45 1 0 09 May 2023
Target-Side Augmentation for Document-Level Machine Translation Guangsheng Bao Zhiyang Teng Yue Zhang 49 10 0 08 May 2023
Token-Level Fitting Issues of Seq2seq Models Guangsheng Bao Zhiyang Teng Yue Zhang 31 0 0 08 May 2023
Train Global, Tailor Local: Minimalist Multilingual Translation into Endangered Languages Zhong Zhou Jan Niehues Alexander Waibel 42 0 0 05 May 2023
Parameter-Efficient Cross-lingual Transfer of Vision and Language Models via Translation-based Alignment Zhen Zhang Jialu Wang Xinze Wang VLM 35 2 0 02 May 2023
ChatGPT as an Attack Tool: Stealthy Textual Backdoor Attack via Blackbox Generative Model Trigger Jiazhao Li Yijin Yang Zhuofeng Wu V. Vydiswaran Chaowei Xiao SILM 69 42 0 27 Apr 2023
Evaluating Inter-Bilingual Semantic Parsing for Indian Languages Divyanshu Aggarwal V. Gupta Anoop Kunchukuttan 50 3 0 25 Apr 2023
IXA/Cogcomp at SemEval-2023 Task 2: Context-enriched Multilingual Named Entity Recognition using Knowledge Bases Iker García-Ferrero Jon Ander Campos Oscar Sainz Ander Salaberria Dan Roth 33 2 0 20 Apr 2023
Prompt-Learning for Cross-Lingual Relation Extraction Chiaming Hsu Changtong Zan Liang Ding Longyue Wang Xiaoting Wang Weifeng Liu Fu Lin Wenbin Hu LRM 36 5 0 20 Apr 2023
Improving Speech Translation by Cross-Modal Multi-Grained Contrastive Learning Hao Zhang Nianwen Si Yaqi Chen Wenlin Zhang Xukui Yang Dan Qu Weiqiang Zhang 40 9 0 20 Apr 2023
Tailoring Domain Adaptation for Machine Translation Quality Estimation Javad Pourmostafa Roshan Sharami D. Shterionov Frédéric Blain Eva Vanmassenhove M. D. Sisto Chris Emmery Pieter Spronck 16 4 0 18 Apr 2023
Transfer to a Low-Resource Language via Close Relatives: The Case Study on Faroese Vésteinn Snaebjarnarson A. Simonsen Goran Glavaš Ivan Vulić 44 19 0 18 Apr 2023
VECO 2.0: Cross-lingual Language Model Pre-training with Multi-granularity Contrastive Learning Zhen-Ru Zhang Chuanqi Tan Songfang Huang Fei Huang VLM 38 5 0 17 Apr 2023
Neural Machine Translation For Low Resource Languages V. Goyle Parvathy Krishnaswamy K. G. Ravikumar Utsa Chattopadhyay Kartikay Goyle 27 0 0 16 Apr 2023
Solving Tensor Low Cycle Rank Approximation Yichuan Deng Yeqi Gao Zhao Song 39 6 0 13 Apr 2023
ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning Viet Dac Lai Nghia Trung Ngo Amir Pouran Ben Veyseh Hieu Man Franck Dernoncourt Trung Bui Thien Huu Nguyen ELM LM&MA 35 271 0 12 Apr 2023
Transfer Learning for Low-Resource Sentiment Analysis Razhan Hameed Sina Ahmadi Fatemeh Daneshfar 35 5 0 10 Apr 2023
Enhancing Speech-to-Speech Translation with Multiple TTS Targets Jiatong Shi Yun Tang Ann Lee Hirofumi Inaguma Changhan Wang J. Pino Shinji Watanabe 46 9 0 10 Apr 2023
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit Brian Yan Jiatong Shi Yun Tang Hirofumi Inaguma Yifan Peng ... Zhaoheng Ni Moto Hira Soumi Maiti J. Pino Shinji Watanabe 21 20 0 10 Apr 2023
Document-Level Machine Translation with Large Language Models Longyue Wang Chenyang Lyu Tianbo Ji Zhirui Zhang Dian Yu Shuming Shi Zhaopeng Tu ELM 33 116 0 05 Apr 2023
SimCSum: Joint Learning of Simplification and Cross-lingual Summarization for Cross-lingual Science Journalism Mehwish Fatima Tim Kolber K. Markert Michael Strube 26 0 0 04 Apr 2023
Efficiently Aligned Cross-Lingual Transfer Learning for Conversational Tasks using Prompt-Tuning Lifu Tu Jin Qu Semih Yavuz Shafiq Joty Wenhao Liu Caiming Xiong Yingbo Zhou 31 7 0 03 Apr 2023
PEACH: Pre-Training Sequence-to-Sequence Multilingual Models for Translation with Semi-Supervised Pseudo-Parallel Document Generation Alireza Salemi Amirhossein Abaskohi Sara Tavakoli Yadollah Yaghoobzadeh A. Shakery AIMat 32 0 0 03 Apr 2023