Multilingual Denoising Pre-training for Neural Machine Translation

22 January 2020

Yinhan Liu

Jiatao Gu

Naman Goyal

Xian Li

Sergey Edunov

Luke Zettlemoyer

Papers citing "Multilingual Denoising Pre-training for Neural Machine Translation"

50 / 935 papers shown

Title
An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text Generation Xuancheng Huang Zijun Liu Peng Li Tao Li Maosong Sun Yang Liu 27 10 0 19 Dec 2022
SESCORE2: Learning Text Generation Evaluation via Synthesizing Realistic Mistakes Wenda Xu Xian Qian Mingxuan Wang Lei Li William Yang Wang 23 10 0 19 Dec 2022
Towards leveraging latent knowledge and Dialogue context for real-world conversational question answering Shaomu Tan Denis Paperno RALM 25 0 0 17 Dec 2022
Better Datastore, Better Translation: Generating Datastores from Pre-Trained Models for Nearest Neural Machine Translation Jiahuan Li Shanbo Cheng Zewei Sun Mingxuan Wang Shujian Huang 55 2 0 17 Dec 2022
BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metric Mingda Chen Paul-Ambroise Duquenne Pierre Yves Andrews Justine T. Kao Alexandre Mourachko Holger Schwenk Marta R. Costa-jussá 21 17 0 16 Dec 2022
UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units Hirofumi Inaguma Sravya Popuri Ilia Kulikov Peng-Jen Chen Changhan Wang Yu-An Chung Yun Tang Ann Lee Shinji Watanabe J. Pino 53 53 0 15 Dec 2022
DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue William B. Held Christopher Hidey Fei Liu Eric Zhu Rahul Goel Diyi Yang Rushin Shah 44 0 0 15 Dec 2022
Multi-VALUE: A Framework for Cross-Dialectal English NLP Caleb Ziems William B. Held Jingfeng Yang Jwala Dhamala Rahul Gupta Diyi Yang 51 41 0 15 Dec 2022
Advancing Multilingual Pre-training: TRIP Triangular Document-level Pre-training for Multilingual Language Models Hongyuan Lu Haoyang Huang Shuming Ma Dongdong Zhang W. Lam Furu Wei 39 4 0 15 Dec 2022
Fixing MoE Over-Fitting on Low-Resource Languages in Multilingual Machine Translation Maha Elbayad Anna Y. Sun Shruti Bhosale MoE 59 9 0 15 Dec 2022
ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages Yekun Chai Shuohuan Wang Chao Pang Yu Sun Hao Tian Hua Wu 38 35 0 13 Dec 2022
P-Transformer: Towards Better Document-to-Document Neural Machine Translation Yachao Li Junhui Li Jing Jiang Shimin Tao Hao Yang Hao Fei ViT 25 9 0 12 Dec 2022
A Survey on Natural Language Processing for Programming Qingfu Zhu Xianzhen Luo Fang Liu Cuiyun Gao Wanxiang Che 25 2 0 12 Dec 2022
Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarization Yiwei Qin Graham Neubig Pengfei Liu 29 3 0 12 Dec 2022
T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics Yiwei Qin Weizhe Yuan Graham Neubig Pengfei Liu 17 23 0 12 Dec 2022
Implementing Deep Learning-Based Approaches for Article Summarization in Indian Languages Rahul Tangsali Aabha Pingle Aditya Vyawahare Isha Joshi Raviraj Joshi 50 7 0 12 Dec 2022
Momentum Calibration for Text Generation Xingxing Zhang Yiran Liu Xun Wang Pengcheng He Yang Yu Si-Qing Chen Wayne Xiong Furu Wei 79 8 0 08 Dec 2022
Impact of Domain-Adapted Multilingual Neural Machine Translation in the Medical Domain Miguel Rios Raluca-Maria Chereji A. Secară D. Ciobanu 29 0 0 05 Dec 2022
Improving End-to-end Speech Translation by Leveraging Auxiliary Speech and Text Data Yuhao Zhang Chen Xu Bojie Hu Chunliang Zhang Tong Xiao Jingbo Zhu 32 15 0 04 Dec 2022
Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer Benjamin Muller Deepanshu Gupta Siddharth Patwardhan J. Fauconnier David Vandyke Sachin Agarwal 43 5 0 04 Dec 2022
Towards Robust NLG Bias Evaluation with Syntactically-diverse Prompts Arshiya Aggarwal Jiao Sun Nanyun Peng 17 6 0 03 Dec 2022
Improving Simultaneous Machine Translation with Monolingual Data Hexuan Deng Liang Ding Xuebo Liu Meishan Zhang Dacheng Tao Min Zhang 42 12 0 02 Dec 2022
A Commonsense-Infused Language-Agnostic Learning Framework for Enhancing Prediction of Political Polarity in Multilingual News Headlines Swati Swati Adrian Mladenic Grobelnik Dunja Mladenić M. Grobelnik 34 3 0 01 Dec 2022
Extending the Subwording Model of Multilingual Pretrained Models for New Languages K. Imamura Eiichiro Sumita VLM 29 3 0 29 Nov 2022
Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling Zhijun Wang Xuebo Liu Min Zhang 35 11 0 23 Nov 2022
HaRiM $^+$ : Evaluating Summary Quality with Hallucination Risk Seonil Son Junsoo Park J. Hwang Junghwa Lee Hyungjong Noh Yeonsoo Lee HILM 19 8 0 22 Nov 2022
Towards continually learning new languages Ngoc-Quan Pham Jan Niehues A. Waibel CLL 11 1 0 21 Nov 2022
Explaining (Sarcastic) Utterances to Enhance Affect Understanding in Multimodal Dialogues Shivani Kumar Ishani Mondal Md. Shad Akhtar Tanmoy Chakraborty 22 9 0 20 Nov 2022
Towards Robust Low-Resource Fine-Tuning with Multi-View Compressed Representations Linlin Liu Xingxuan Li Megh Thakkar Xin Li Shafiq Joty Luo Si Lidong Bing 32 2 0 16 Nov 2022
A Benchmark and Dataset for Post-OCR text correction in Sanskrit Ayush Maheshwari Nikhil Singh Amrith Krishna Ganesh Ramakrishnan 34 12 0 15 Nov 2022
Hierarchical Phrase-based Sequence-to-Sequence Learning Bailin Wang Ivan Titov Jacob Andreas Yoon Kim 26 7 0 15 Nov 2022
Language Agnostic Code-Mixing Data Augmentation by Predicting Linguistic Patterns Shuyue Stella Li Kenton W. Murray 34 4 0 14 Nov 2022
Findings of the Covid-19 MLIA Machine Translation Task F. Casacuberta Alexandru Ceausu K. Choukri Miltos Deligiannis Miguel Domingo ... V. Papavassiliou Stelios Piperidis Prokopis Prokopidis Dimitris Roussis M. Salah 16 0 0 14 Nov 2022
Speech-to-Speech Translation For A Real-world Unwritten Language Peng-Jen Chen Ke M. Tran Yilin Yang Jingfei Du Justine T. Kao ... Sravya Popuri Changhan Wang J. Pino Wei-Ning Hsu Ann Lee 39 26 0 11 Nov 2022
English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddings Yau-Shian Wang Ashley Wu Graham Neubig SSL 40 31 0 11 Nov 2022
Casual Conversations v2: Designing a large consent-driven dataset to measure algorithmic bias and robustness C. Hazirbas Yejin Bang Tiezheng Yu Parisa Assar Bilal Porgali ... Jacqueline Pan Emily McReynolds Miranda Bogen Pascale Fung Cristian Canton Ferrer 39 8 0 10 Nov 2022
Local Structure Matters Most in Most Languages Louis Clouâtre Prasanna Parthasarathi Amal Zouaq Sarath Chandar 39 1 0 09 Nov 2022
Efficient Speech Translation with Pre-trained Models Zhaolin Li Jan Niehues 27 2 0 09 Nov 2022
Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token Baohao Liao David Thulke Sanjika Hewavitharana Hermann Ney Christof Monz 36 9 0 09 Nov 2022
ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generation Bin Shan Yaqian Han Weichong Yin Shuohuan Wang Yu Sun Hao Tian Hua Wu Haifeng Wang MLLM VLM 24 7 0 09 Nov 2022
SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations Paul-Ambroise Duquenne Hongyu Gong Ning Dong Jingfei Du Ann Lee Vedanuj Goswani Changhan Wang J. Pino Benoît Sagot Holger Schwenk 47 34 0 08 Nov 2022
Continual Learning of Neural Machine Translation within Low Forgetting Risk Regions Shuhao Gu Bojie Hu Yang Feng CLL 44 13 0 03 Nov 2022
Two-Stream Network for Sign Language Recognition and Translation Yutong Chen Ronglai Zuo Fangyun Wei Yu-Huan Wu Shujie Liu Brian Mak SLR 44 118 0 02 Nov 2022
T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5 Chan-Jan Hsu Ho-Lam Chung Hung-yi Lee Yu Tsao 33 6 0 01 Nov 2022
Leveraging Pre-trained Models for Failure Analysis Triplets Generation Kenneth Ezukwoke Anis Hoayek M. Batton-Hubert Xavier Boucher Pascal Gounet Jerome Adrian 35 1 0 31 Oct 2022
Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation Kun Wei Long Zhou Zi-Hua Zhang Liping Chen Shujie Liu Lei He Jinyu Li Furu Wei 35 13 0 31 Oct 2022
Multilingual Multimodality: A Taxonomical Survey of Datasets, Techniques, Challenges and Opportunities Khyathi Raghavi Chandu A. Geramifard 42 3 0 30 Oct 2022
Improving Zero-Shot Multilingual Translation with Universal Representations and Cross-Mappings Shuhao Gu Yang Feng 29 11 0 28 Oct 2022
Improving Speech-to-Speech Translation Through Unlabeled Text Xuan-Phi Nguyen Sravya Popuri Changhan Wang Yun Tang Ilia Kulikov Hongyu Gong 19 9 0 26 Oct 2022
Exploring Document-Level Literary Machine Translation with Parallel Paragraphs from World Literature Katherine Thai Marzena Karpinska Kalpesh Krishna Bill Ray M. Inghilleri John Wieting Mohit Iyyer 22 43 0 25 Oct 2022