Multilingual Denoising Pre-training for Neural Machine Translation

22 January 2020

Yinhan Liu

Jiatao Gu

Naman Goyal

Xian Li

Sergey Edunov

Luke Zettlemoyer

Papers citing "Multilingual Denoising Pre-training for Neural Machine Translation"

50 / 934 papers shown

Title
CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailment Haoyu Song Li Dong Weinan Zhang Ting Liu Furu Wei VLM CLIP 33 137 0 14 Mar 2022
Low-Rank Softmax Can Have Unargmaxable Classes in Theory but Rarely in Practice Andreas Grivas Nikolay Bogoychev Adam Lopez 17 9 0 12 Mar 2022
When did you become so smart, oh wise one?! Sarcasm Explanation in Multi-modal Multi-party Dialogues Shivani Kumar Atharva Kulkarni Md. Shad Akhtar Tanmoy Chakraborty 19 40 0 12 Mar 2022
Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons Akash Kumar Mohankumar Mitesh M. Khapra ELM AAML 21 7 0 11 Mar 2022
IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languages Aman Kumar Himani Shrotriya P. Sahu Raj Dabre Ratish Puduppully Anoop Kunchukuttan Amogh Mishra Mitesh M. Khapra Pratyush Kumar 46 38 0 10 Mar 2022
Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods Wei Li Wenhao Wu Moye Chen Jiachen Liu Xinyan Xiao Hua Wu HILM 29 27 0 10 Mar 2022
A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation Yutong Chen Fangyun Wei Xiao Sun Zhirong Wu Stephen Lin SLR 35 98 0 08 Mar 2022
A Variational Hierarchical Model for Neural Cross-Lingual Summarization Yunlong Liang Fandong Meng Chulun Zhou Jinan Xu Jinan Xu Jinsong Su Jie Zhou BDL 22 34 0 08 Mar 2022
Focus on the Target's Vocabulary: Masked Label Smoothing for Machine Translation Liang Chen Runxin Xu Baobao Chang 11 6 0 06 Mar 2022
As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive Conditioning Jannis Vamvas Rico Sennrich 30 19 0 03 Mar 2022
COMPASS: a Creative Support System that Alerts Novelists to the Unnoticed Missing Contents Yusuke Mori Hiroaki Yamane Ryohei Shimizu Yusuke Mukuta Tatsuya Harada 29 6 0 26 Feb 2022
Using natural language prompts for machine translation Xavier Garcia Orhan Firat AI4CE 35 30 0 23 Feb 2022
CALCS 2021 Shared Task: Machine Translation for Code-Switched Data Shuguang Chen Gustavo Aguilar A. Srinivasan Mona T. Diab Thamar Solorio 55 15 0 19 Feb 2022
Models and Datasets for Cross-Lingual Summarisation Laura Perez-Beltrachini Mirella Lapata 24 49 0 19 Feb 2022
Russian SuperGLUE 1.1: Revising the Lessons not Learned by Russian NLP models Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Tatiana Shavrina Anton A. Emelyanov Denis Shevelev Alexander Kukushkin Valentin Malykh Ekaterina Artemova AAML VLM ELM 39 2 0 15 Feb 2022
Sequence-to-Sequence Resources for Catalan Ona de Gibert Ksenia Kharitonova B. Figueras Jordi Armengol-Estapé Maite Melero 19 0 0 14 Feb 2022
Machine Translation from Signed to Spoken Languages: State of the Art and Challenges Mathieu De Coster D. Shterionov Mieke Van Herreweghe J. Dambre SLR 24 40 0 07 Feb 2022
Exploring Self-Attention Mechanisms for Speech Separation Cem Subakan Mirco Ravanelli Samuele Cornell François Grondin Mirko Bronzi 40 23 0 06 Feb 2022
Data Scaling Laws in NMT: The Effect of Noise and Architecture Yamini Bansal Behrooz Ghorbani Ankush Garg Biao Zhang M. Krikun Colin Cherry Behnam Neyshabur Orhan Firat 42 47 0 04 Feb 2022
Toward a traceable, explainable, and fairJD/Resume recommendation system Amine Barrak Bram Adams Amal Zouaq 21 2 0 02 Feb 2022
Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation Olga Majewska E. Razumovskaia Edoardo Ponti Ivan Vulić Anna Korhonen 37 28 0 31 Jan 2022
DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence Wei Zhao Michael Strube Steffen Eger 27 37 0 26 Jan 2022
A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model Xin Sun Tao Ge Shuming Ma Jingjing Li Furu Wei Houfeng Wang SyDa 36 26 0 26 Jan 2022
Linguistically-driven Multi-task Pre-training for Low-resource Neural Machine Translation Zhuoyuan Mao Chenhui Chu Sadao Kurohashi 17 6 0 20 Jan 2022
Improving Neural Machine Translation by Denoising Training Liang Ding Keqin Peng Dacheng Tao VLM AI4CE 48 6 0 19 Jan 2022
An Empirical Study on the Overlapping Problem of Open-Domain Dialogue Datasets Yuqiao Wen Guoqing Luo Lili Mou 16 9 0 17 Jan 2022
Cost-Effective Training in Low-Resource Neural Machine Translation Sai Koneru Danni Liu Jan Niehues 31 1 0 14 Jan 2022
A Warm Start and a Clean Crawled Corpus -- A Recipe for Good Language Models Vésteinn Snæbjarnarson Haukur Barri Símonarson Pétur Orri Ragnarsson Svanhvít Lilja Ingólfsdóttir H. Jónsson Vilhjálmur Þorsteinsson H. Einarsson 24 26 0 14 Jan 2022
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models Hanqing Zhang Haolin Song Shaoyu Li Ming Zhou Dawei Song 57 215 0 14 Jan 2022
Pretrained Language Models for Text Generation: A Survey Junyi Li Tianyi Tang Wayne Xin Zhao J. Nie Ji-Rong Wen AI4CE 36 128 0 14 Jan 2022
Speech Resources in the Tamasheq Language Marcely Zanon Boito Fethi Bougares Florentin Barbier Souhir Gahbiche Loïc Barrault Mickael Rouvier Yannick Esteve 28 14 0 13 Jan 2022
SMDT: Selective Memory-Augmented Neural Document Translation Xu Zhang Jian Yang Haoyang Huang Shuming Ma Dongdong Zhang Jinlong Li Furu Wei 24 2 0 05 Jan 2022
Investigating Effect of Dialogue History in Multilingual Task Oriented Dialogue Systems Michael Sun Kaili Huang M. Moradshahi 14 0 0 23 Dec 2021
Few-shot Learning with Multilingual Language Models Xi Lin Todor Mihaylov Mikel Artetxe Tianlu Wang Shuohui Chen ... Luke Zettlemoyer Zornitsa Kozareva Mona T. Diab Ves Stoyanov Xian Li BDL ELM LRM 64 287 0 20 Dec 2021
CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs Abhik Bhattacharjee Tahmid Hasan Wasi Uddin Ahmad Yuan-Fang Li Yong-Bin Kang Rifat Shahriyar RALM ELM 48 37 0 16 Dec 2021
DOCmT5: Document-Level Pretraining of Multilingual Language Models Chia-Hsuan Lee Aditya Siddhant Viresh Ratnakar Melvin Johnson LRM 25 9 0 16 Dec 2021
Idiomatic Expression Paraphrasing without Strong Supervision Jianing Zhou Ziheng Zeng Hongyu Gong S. Bhat 39 10 0 16 Dec 2021
AllWOZ: Towards Multilingual Task-Oriented Dialog Systems for All Lei Zuo Kun Qian Bowen Yang Zhou Yu 32 14 0 15 Dec 2021
Learning to Transpile AMR into SPARQL Mihaela A. Bornea Ramón Fernández Astudillo Tahira Naseem Nandana Mihindukulasooriya Ibrahim Abdelaziz Pavan Kapanipathi Radu Florian Salim Roukos 39 6 0 15 Dec 2021
Massive-scale Decoding for Text Generation using Lattices Jiacheng Xu Siddhartha Reddy Jonnalagadda Greg Durrett AI4CE 40 8 0 14 Dec 2021
Team Hitachi @ AutoMin 2021: Reference-free Automatic Minuting Pipeline with Argument Structure Construction over Topic-based Summarization Atsuki Yamaguchi Gaku Morio Hiroaki Ozaki Ken-ichi Yokote Kenji Nagamatsu 22 13 0 06 Dec 2021
Protecting Intellectual Property of Language Generation APIs with Lexical Watermark Xuanli He Qiongkai Xu Lingjuan Lyu Fangzhao Wu Chenguang Wang WaLM 180 95 0 05 Dec 2021
Multitask Finetuning for Improving Neural Machine Translation in Indian Languages Shaily Desai Atharva Kshirsagar M. Marathe 23 2 0 03 Dec 2021
OCR-free Document Understanding Transformer Geewook Kim Teakgyu Hong Moonbin Yim Jeongyeon Nam Jinyoung Park Jinyeong Yim Wonseok Hwang Sangdoo Yun Dongyoon Han Seunghyun Park ViT 68 264 0 30 Nov 2021
Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs Amr Hendy Esraa A. Gad M. Abdelghaffar Jailan S. ElMosalami Mohamed Afify Ahmed Tawfik Hany Awadalla MoE 29 3 0 26 Nov 2021
Utilizing Resource-Rich Language Datasets for End-to-End Scene Text Recognition in Resource-Poor Languages Shota Orihashi Yoshihiro Yamazaki Naoki Makishima Mana Ihori Akihiko Takashima Tomohiro Tanaka Ryo Masumura 42 1 0 24 Nov 2021
Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples Linlin Liu Xin Li Ruidan He Lidong Bing Chenyu You Luo Si KELM 42 18 0 22 Nov 2021
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale Arun Babu Changhan Wang Andros Tjandra Kushal Lakhotia Qiantong Xu ... Yatharth Saraf J. Pino Alexei Baevski Alexis Conneau Michael Auli SSL 32 665 0 17 Nov 2021
DEEP: DEnoising Entity Pre-training for Neural Machine Translation Junjie Hu Hiroaki Hayashi Kyunghyun Cho Graham Neubig AI4CE 27 21 0 14 Nov 2021
BitextEdit: Automatic Bitext Editing for Improved Low-Resource Machine Translation Eleftheria Briakou Sida Wang Luke Zettlemoyer Marjan Ghazvininejad 34 5 0 12 Nov 2021