Multilingual Denoising Pre-training for Neural Machine Translation

22 January 2020

Yinhan Liu

Jiatao Gu

Naman Goyal

Xian Li

Sergey Edunov

Luke Zettlemoyer

Papers citing "Multilingual Denoising Pre-training for Neural Machine Translation"

50 / 933 papers shown

Title
On Bilingual Lexicon Induction with Large Language Models Yaoyiran Li Anna Korhonen Ivan Vulić 34 3 0 21 Oct 2023
Document-Level Language Models for Machine Translation Frithjof Petrick Christian Herold Pavel Petrushkov Shahram Khadivi Hermann Ney 24 9 0 18 Oct 2023
Towards a Better Understanding of Variations in Zero-Shot Neural Machine Translation Performance Shaomu Tan Christof Monz 38 11 0 16 Oct 2023
Empirical study of pretrained multilingual language models for zero-shot cross-lingual knowledge transfer in generation Nadezhda Chirkova Sheng Liang Vassilina Nikoulina 19 0 0 15 Oct 2023
PuoBERTa: Training and evaluation of a curated language model for Setswana Vukosi Marivate Moseli Motsóehli Valencia Wagner Richard Lastrucci Isheanesu Dzingirai 33 8 0 13 Oct 2023
A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models Yihan Wu Zhengmian Hu Junfeng Guo Hongyang R. Zhang Heng-Chiao Huang WaLM 27 21 0 11 Oct 2023
Exploring the Maze of Multilingual Modeling Sina Bagheri Nezhad Ameeta Agrawal 18 1 0 09 Oct 2023
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4 Katikapalli Subramanyam Kalyan LM&MA AI4CE LRM AILaw ELM 43 224 0 04 Oct 2023
It's MBR All the Way Down: Modern Generation Techniques Through the Lens of Minimum Bayes Risk Amanda Bertsch Alex Xie Graham Neubig Matthew R. Gormley 43 32 0 02 Oct 2023
RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models Zekun Wang Zhongyuan Peng Haoran Que Jiaheng Liu Wangchunshu Zhou ... Wanli Ouyang Ke Xu Wenhu Chen Jie Fu Junran Peng LLMAG 47 85 0 01 Oct 2023
Cross-Modal Multi-Tasking for Speech-to-Text Translation via Hard Parameter Sharing B. Grimstad Xuankai Chang Antonios Anastasopoulos Yuya Fujita Shinji Watanabe 28 2 0 27 Sep 2023
Survey of Social Bias in Vision-Language Models Nayeon Lee Yejin Bang Holy Lovenia Samuel Cahyawijaya Wenliang Dai Pascale Fung VLM 47 16 0 24 Sep 2023
Unbiased Watermark for Large Language Models Zhengmian Hu Lichang Chen Xidong Wu Yihan Wu Hongyang R. Zhang Heng-Chiao Huang WaLM 38 45 0 22 Sep 2023
Unlocking Model Insights: A Dataset for Automated Model Card Generation Shruti Singh Hitesh Lodwal Husain Malwat Rakesh Thakur Mayank Singh SyDa 24 3 0 22 Sep 2023
OSN-MDAD: Machine Translation Dataset for Arabic Multi-Dialectal Conversations on Online Social Media Fatimah Alzamzami Abdulmotaleb El Saddik 11 3 0 21 Sep 2023
A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models Haoran Xu Young Jin Kim Amr Sharaf Hany Awadalla 41 57 0 20 Sep 2023
A Family of Pretrained Transformer Language Models for Russian Dmitry Zmitrovich Alexander Abramov Andrey Kalmykov Maria Tikhonova Ekaterina Taktasheva ... Vitalii Kadulin Sergey Markov Tatiana Shavrina Vladislav Mikhailov Alena Fenogenova 33 26 0 19 Sep 2023
Self-Augmentation Improves Zero-Shot Cross-Lingual Transfer Fei Wang Kuan-Hao Huang Kai-Wei Chang Muhao Chen 36 4 0 19 Sep 2023
NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages Samuel Cahyawijaya Holy Lovenia Fajri Koto Dea Adhista Emmanuel Dave ... Genta Indra Winata David Moeljadi Alham Fikri Aji Ayu Purwarianti Pascale Fung 49 7 0 19 Sep 2023
Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca Pinzhen Chen Shaoxiong Ji Nikolay Bogoychev Andrey Kutuzov Barry Haddow Kenneth Heafield 31 45 0 16 Sep 2023
How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models? Danni Liu Jan Niehues 16 3 0 15 Sep 2023
Direct Text to Speech Translation System using Acoustic Units Victoria Mingote Pablo Gimeno Luis Vicente Sameer Khurana Antoine Laurent J. Duret 31 3 0 14 Sep 2023
SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects David Ifeoluwa Adelani Hannah Liu Xiaoyu Shen Nikita Vassilyev Jesujoba Oluwadara Alabi Yanke Mao Haonan Gao Annie En-Shiun Lee ELM 38 63 0 14 Sep 2023
Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkish Arda Uzunouglu Gözde Gül Sahin 34 4 0 13 Sep 2023
The Effect of Alignment Objectives on Code-Switching Translation Mohamed Anwar 18 1 0 10 Sep 2023
Unsupervised Chunking with Hierarchical RNN Zijun Wu Anup Anand Deshmukh Yongkang Wu Jimmy Lin Lili Mou 34 3 0 10 Sep 2023
Embedding structure matters: Comparing methods to adapt multilingual vocabularies to new languages C.M. Downey Terra Blevins Nora Goldfine Shane Steinert-Threlkeld 33 8 0 09 Sep 2023
Persona-aware Generative Model for Code-mixed Language Ayan Sengupta Md. Shad Akhtar Tanmoy Chakraborty 19 0 0 06 Sep 2023
Simple LLM Prompting is State-of-the-Art for Robust and Multilingual Dialogue Evaluation J. Mendoncca Patrícia Pereira Helena Moniz Joao Paulo Carvalho A. Lavie Isabel Trancoso 26 19 0 31 Aug 2023
Towards Multilingual Automatic Dialogue Evaluation John Mendonça A. Lavie Isabel Trancoso 27 0 0 31 Aug 2023
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation Devaansh Gupta Siddhant Kharbanda Jiawei Zhou Wanhua Li Hanspeter Pfister D. Wei VLM 39 9 0 29 Aug 2023
Translate Meanings, Not Just Words: IdiomKB's Role in Optimizing Idiomatic Translation with Language Models Shuang Li Jiangjie Chen Siyu Yuan Xinyi Wu Hao Yang Shimin Tao Yanghua Xiao 48 15 0 26 Aug 2023
SONAR: Sentence-Level Multimodal and Language-Agnostic Representations Paul-Ambroise Duquenne Holger Schwenk Benoît Sagot AI4TS VLM 34 60 0 22 Aug 2023
Improving Continuous Sign Language Recognition with Cross-Lingual Signs Fangyun Wei Yutong Chen SLR 28 28 0 21 Aug 2023
VBD-MT Chinese-Vietnamese Translation Systems for VLSP 2022 H. Trieu Song Kiet Bui T. M. Tran Van-Khanh Tran H. Nguyen VLM MoE 32 1 0 15 Aug 2023
A Case Study on Context Encoding in Multi-Encoder based Document-Level Neural Machine Translation Ramakrishna Appicharla Baban Gain Santanu Pal Asif Ekbal 35 1 0 11 Aug 2023
Bringing order into the realm of Transformer-based language models for artificial intelligence and law C. M. Greco Andrea Tagarelli AILaw 24 19 0 10 Aug 2023
End-to-End Evaluation for Low-Latency Simultaneous Speech Translation Christian Huber Tu Anh Dinh Carlos Mullov Ngoc-Quan Pham Thai-Binh Nguyen ... Danni Liu Zhaolin Li Sai Koneru Jan Niehues A. Waibel 28 3 0 07 Aug 2023
Many-to-Many Spoken Language Translation via Unified Speech and Text Representation Learning with Unit-to-Unit Translation Minsu Kim J. Choi Dahun Kim Y. Ro 40 12 0 03 Aug 2023
Towards Effective Ancient Chinese Translation: Dataset, Model, and Evaluation Geyang Guo Jiarong Yang Fengyuan Lu Jiaxin Qin Tianyi Tang Wayne Xin Zhao 9 9 0 01 Aug 2023
SelfSeg: A Self-supervised Sub-word Segmentation Method for Neural Machine Translation Haiyue Song Raj Dabre Chenhui Chu Sadao Kurohashi Eiichiro Sumita 16 3 0 31 Jul 2023
Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback Viet Dac Lai Chien Van Nguyen Nghia Trung Ngo Thuat Nguyen Franck Dernoncourt Ryan A. Rossi Thien Huu Nguyen ALM 42 131 0 29 Jul 2023
BARTPhoBEiT: Pre-trained Sequence-to-Sequence and Image Transformers Models for Vietnamese Visual Question Answering Khiem Vinh Tran Kiet Van Nguyen Ngan Luu-Thuy Nguyen ViT 33 2 0 28 Jul 2023
Gloss-free Sign Language Translation: Improving from Visual-Language Pretraining Benjia Zhou Zhigang Chen Albert Clapés Jun Wan Yanyan Liang Sergio Escalera Zhen Lei Du Zhang SLR 33 47 0 27 Jul 2023
Joint Dropout: Improving Generalizability in Low-Resource Neural Machine Translation through Phrase Pair Variables Ali Araabi Vlad Niculae Christof Monz 52 1 0 24 Jul 2023
Exploring the Landscape of Natural Language Processing Research Tim Schopf Karim Arabi Florian Matthes 21 13 0 20 Jul 2023
Disco-Bench: A Discourse-Aware Evaluation Benchmark for Language Modelling Longyue Wang Zefeng Du Donghua Liu Cai Deng Dian Yu Haiyun Jiang Yan Wang Leyang Cui Shuming Shi Zhaopeng Tu CoGe 60 6 0 16 Jul 2023
Pluggable Neural Machine Translation Models via Memory-augmented Adapters Yuzhuang Xu Shuo Wang Peng Li Xuebo Liu Xiaolong Wang Weidong Liu Yang Liu 44 1 0 12 Jul 2023
The NPU-MSXF Speech-to-Speech Translation System for IWSLT 2023 Speech-to-Speech Translation Task Kun Song Yinjiao Lei Pei-Ning Chen Yiqing Cao Kun Wei Yongmao Zhang Linfu Xie Ning Jiang Guoqing Zhao 29 1 0 10 Jul 2023
LOAF-M2L: Joint Learning of Wording and Formatting for Singable Melody-to-Lyric Generation Longshen Ou Xichu Ma Ye Wang 25 2 0 05 Jul 2023