Multilingual Denoising Pre-training for Neural Machine Translation

22 January 2020

Yinhan Liu

Jiatao Gu

Naman Goyal

Xian Li

Sergey Edunov

Luke Zettlemoyer

Papers citing "Multilingual Denoising Pre-training for Neural Machine Translation"

50 / 935 papers shown

Title
GreekBART: The First Pretrained Greek Sequence-to-Sequence Model Iakovos Evdaimon Hadi Abdine Christos Xypolopoulos Stamatis Outsios Michalis Vazirgiannis Giorgos Stamou VLM 36 7 0 03 Apr 2023
Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinations Jungo Kasai Y. Kasai Keisuke Sakaguchi Yutaro Yamada Dragomir R. Radev LM&MA ELM 32 103 0 31 Mar 2023
Exploiting Multilingualism in Low-resource Neural Machine Translation via Adversarial Learning Amit Kumar A. Pratap Anil Kumar Singh AI4CE 24 1 0 31 Mar 2023
Summarizing Indian Languages using Multilingual Transformers based Models Dhaval Taunk Vasudeva Varma VLM 32 9 0 29 Mar 2023
Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translation Alex Jones Isaac Caswell Ishan Saxena Orhan Firat 25 9 0 27 Mar 2023
Indian Language Summarization using Pretrained Sequence-to-Sequence Models Ashok Urlana S. Bhatt Nirmal Surange Manish Shrivastava 57 13 0 25 Mar 2023
XWikiGen: Cross-lingual Summarization for Encyclopedic Text Generation in Low Resource Languages Dhaval Taunk Shivprasad Sagare Anupam Patil Shivansh Subramanian Manish Gupta Vasudeva Varma 25 3 0 22 Mar 2023
Towards Reliable Neural Machine Translation with Consistency-Aware Meta-Learning Rongxiang Weng Qiang Wang Wensen Cheng Changfeng Zhu Min Zhang 32 2 0 20 Mar 2023
PR-MCS: Perturbation Robust Metric for MultiLingual Image Captioning Yongil Kim Yerin Hwang Hyeongu Yun Seunghyun Yoon Trung Bui Kyomin Jung 27 6 0 15 Mar 2023
MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition Xize Cheng Lin Li Tao Jin Rongjie Huang Wang Lin Zehan Wang Huangdai Liu Yejin Wang Aoxiong Yin Zhou Zhao 34 24 0 09 Mar 2023
CroCoSum: A Benchmark Dataset for Cross-Lingual Code-Switched Summarization Ruochen Zhang Carsten Eickhoff 48 5 0 07 Mar 2023
Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together! Shiwei Liu Tianlong Chen Zhenyu Zhang Xuxi Chen Tianjin Huang Ajay Jaiswal Zhangyang Wang 39 29 0 03 Mar 2023
Denoising-based UNMT is more robust to word-order divergence than MASS-based UNMT Tamali Banerjee V. Rudra Murthy P. Bhattacharyya 32 0 0 02 Mar 2023
Zero-Shot Cross-Lingual Summarization via Large Language Models Jiaan Wang Yunlong Liang Fandong Meng Beiqi Zou Zhixu Li Jianfeng Qu Jie Zhou ELM 31 28 0 28 Feb 2023
Are Character-level Translations Worth the Wait? Comparing ByT5 and mT5 for Machine Translation Lukas Edman Gabriele Sarti Antonio Toral Gertjan van Noord Arianna Bisazza 24 12 0 28 Feb 2023
Strategize Before Teaching: A Conversational Tutoring System with Pedagogy Self-Distillation Lingzhi Wang Mrinmaya Sachan Xingshan Zeng Kam-Fai Wong 38 11 0 27 Feb 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić Edoardo Ponti MoMe OOD 34 73 0 22 Feb 2023
Zero and Few-Shot Localization of Task-Oriented Dialogue Agents with a Distilled Representation M. Moradshahi Sina J. Semnani M. Lam 30 7 0 18 Feb 2023
How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation Amr Hendy M. Abdelrehim Amr Sharaf Vikas Raunak Mohamed Gabr Hitokazu Matsushita Young Jin Kim Mohamed Afify Hany Awadalla ELM LM&MA AI4CE 40 416 0 18 Feb 2023
Towards Fine-Grained Information: Identifying the Type and Location of Translation Errors Keqin Bao Boyi Deng Dayiheng Liu Baosong Yang Wenqiang Lei Xiangnan He Derek F.Wong Jun Xie 42 4 0 17 Feb 2023
Evaluating and Improving the Coreference Capabilities of Machine Translation Models Asaf Yehudai Arie Cattan Omri Abend Gabriel Stanovsky LRM ELM 35 2 0 16 Feb 2023
Document Flattening: Beyond Concatenating Context for Document-Level Neural Machine Translation Minghao Wu George F. Foster Lizhen Qu Gholamreza Haffari 24 19 0 16 Feb 2023
READIN: A Chinese Multi-Task Benchmark with Realistic and Diverse Input Noises Chenglei Si Zhengyan Zhang Yingfa Chen Xiaozhi Wang Zhiyuan Liu Maosong Sun AAML 31 1 0 14 Feb 2023
The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation Kushal Arora Timothy J. O'Donnell Doina Precup Jason Weston Jackie C.K.Cheung 23 1 0 14 Feb 2023
Transformer models: an introduction and catalog X. Amatriain Ananth Sankar Jie Bing Praveen Kumar Bodigutla Timothy J. Hazen Michaeel Kazi 34 50 0 12 Feb 2023
Language-Aware Multilingual Machine Translation with Self-Supervised Learning Haoran Xu Jean Maillard Vedanuj Goswami LRM 45 3 0 10 Feb 2023
Protecting Language Generation Models via Invisible Watermarking Xuandong Zhao Yu-Xiang Wang Lei Li WaLM 24 83 0 06 Feb 2023
Sentence Identification with BOS and EOS Label Combinations Takuma Udagawa H. Kanayama Issei Yoshida 19 2 0 31 Jan 2023
LoRaLay: A Multilingual and Multimodal Dataset for Long Range and Layout-Aware Summarization Laura Nguyen Thomas Scialom Benjamin Piwowarski Jacopo Staiano 27 7 0 26 Jan 2023
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models Davis Liang Hila Gonen Yuning Mao Rui Hou Naman Goyal Marjan Ghazvininejad Luke Zettlemoyer Madian Khabsa 20 73 0 25 Jan 2023
ViDeBERTa: A powerful pre-trained language model for Vietnamese Cong Dao Tran Nhut Huy Pham Anh-Viêt Nguyên Truong-Son Hy Tu Vu 27 14 0 25 Jan 2023
SPEC5G: A Dataset for 5G Cellular Network Protocol Analysis Imtiaz Karim Kazi Samin Mubasshir Mirza Masfiqur Rahman Elisa Bertino 19 22 0 22 Jan 2023
SuperScaler: Supporting Flexible DNN Parallelization via a Unified Abstraction Zhiqi Lin Youshan Miao Guodong Liu Xiaoxiang Shi Quanlu Zhang ... Xu Cao Cheng-Wu Li Mao Yang Lintao Zhang Lidong Zhou 26 6 0 21 Jan 2023
On the State of German (Abstractive) Text Summarization Dennis Aumiller Jing Fan Michael Gertz 31 1 0 17 Jan 2023
The Recent Advances in Automatic Term Extraction: A survey T. Hanh Matej Martinc Jaya Caporusso Antoine Doucet Senja Pollak 32 9 0 17 Jan 2023
Building a Parallel Corpus and Training Translation Models Between Luganda and English Richard Kimera Daniela N. Rim Heeyoul Choi 27 9 0 07 Jan 2023
MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing Longxu Dou Yan Gao Mingyang Pan Dingzirui Wang Wanxiang Che Dechen Zhan Jian-Guang Lou 31 19 0 27 Dec 2022
Don't Be So Sure! Boosting ASR Decoding via Confidence Relaxation Tomer Wullach Shlomo E. Chazan 30 1 0 27 Dec 2022
TextBox 2.0: A Text Generation Library with Pre-trained Language Models Tianyi Tang Junyi Li Z. Chen Yiwen Hu Zhuohao Yu ... Xiaoxue Cheng Yuhao Wang Wayne Xin Zhao J. Nie Ji-Rong Wen 29 8 0 26 Dec 2022
SERENGETI: Massively Multilingual Language Models for Africa Ife Adebara AbdelRahim Elmadany Muhammad Abdul-Mageed Alcides Alcoba Inciarte 27 29 0 21 Dec 2022
Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translation Fei Yuan Yinquan Lu Wenhao Zhu Lingpeng Kong Lei Li Yu Qiao Jingjing Xu MoE 38 22 0 20 Dec 2022
MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialogue Nikita Moghe E. Razumovskaia Liane Guillou Ivan Vulić Anna Korhonen Alexandra Birch 45 13 0 20 Dec 2022
SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers Hongyi Yuan Zheng Yuan Chuanqi Tan Fei Huang Songfang Huang DiffM 41 65 0 20 Dec 2022
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator Jian Yang Shuming Ma Li Dong Shaohan Huang Haoyang Huang Yuwei Yin Dongdong Zhang Liqun Yang Furu Wei Zhoujun Li SyDa AI4CE 37 25 0 20 Dec 2022
EIT: Enhanced Interactive Transformer Tong Zheng Bei Li Huiwen Bao Tong Xiao Jingbo Zhu 37 2 0 20 Dec 2022
IndicMT Eval: A Dataset to Meta-Evaluate Machine Translation metrics for Indian Languages Ananya B. Sai Vignesh Nagarajan Tanay Dixit Raj Dabre Anoop Kunchukuttan Pratyush Kumar Mitesh M. Khapra 57 21 0 20 Dec 2022
Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation Matthieu Futeral Cordelia Schmid Ivan Laptev Benoît Sagot Rachel Bawden 33 26 0 20 Dec 2022
Synthetic Pre-Training Tasks for Neural Machine Translation Zexue He Graeme W. Blackwood Yikang Shen Julian McAuley Rogerio Feris 29 3 0 19 Dec 2022
Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languages Ercong Nie Sheng Liang Helmut Schmid Hinrich Schütze VLM RALM LRM 35 22 0 19 Dec 2022
Empowering Diffusion Models on the Embedding Space for Text Generation Zhujin Gao Junliang Guo Xuejiao Tan Yongxin Zhu Fang Zhang Jiang Bian Linli Xu DiffM 35 15 0 19 Dec 2022