When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?

17 April 2018

Ye Qi

Devendra Singh Sachan

Matthieu Felix

Sarguna Padmanabhan

Graham Neubig

ArXiv PDF HTML

Papers citing "When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?"

50 / 203 papers shown

Title
ApproxTrain: Fast Simulation of Approximate Multipliers for DNN Training and Inference Jing Gong Hassaan Saadat Hasindu Gamaarachchi Haris Javaid X. Hu S. Parameswaran 36 14 0 09 Sep 2022
Adapting to Non-Centered Languages for Zero-shot Multilingual Translation Zhi Qu Taro Watanabe 50 7 0 09 Sep 2022
Informative Language Representation Learning for Massively Multilingual Neural Machine Translation Renren Jin Deyi Xiong 36 4 0 04 Sep 2022
Benchmarking Azerbaijani Neural Machine Translation Chih-Chen Chen William Chen 21 0 0 29 Jul 2022
Motley: Benchmarking Heterogeneity and Personalization in Federated Learning Shan-shan Wu Tian Li Zachary B. Charles Yu Xiao Ziyu Liu Zheng Xu Virginia Smith FedML 40 44 0 18 Jun 2022
When does Parameter-Efficient Transfer Learning Work for Machine Translation? Ahmet Üstün Asa Cooper Stickland 37 7 0 23 May 2022
Understanding and Mitigating the Uncertainty in Zero-Shot Translation Wenxuan Wang Wenxiang Jiao Shuo Wang Zhaopeng Tu Michael R. Lyu UQLM 35 9 0 20 May 2022
You Are What You Write: Preserving Privacy in the Era of Large Language Models Richard Plant V. Giuffrida Dimitra Gkatzia PILM 38 19 0 20 Apr 2022
CipherDAug: Ciphertext based Data Augmentation for Neural Machine Translation Nishant Kambhatla Logan Born Anoop Sarkar 21 16 0 01 Apr 2022
Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation Ye Jia Yifan Ding Ankur Bapna Colin Cherry Yu Zhang Alexis Conneau Nobuyuki Morioka 47 20 0 24 Mar 2022
Improving Word Translation via Two-Stage Contrastive Learning Yaoyiran Li Fangyu Liu Nigel Collier Anna Korhonen Ivan Vulić 44 29 0 15 Mar 2022
Can Synthetic Translations Improve Bitext Quality? Eleftheria Briakou Marine Carpuat 19 5 0 15 Mar 2022
DeepNet: Scaling Transformers to 1,000 Layers Hongyu Wang Shuming Ma Li Dong Shaohan Huang Dongdong Zhang Furu Wei MoE AI4CE 26 157 0 01 Mar 2022
Using natural language prompts for machine translation Xavier Garcia Orhan Firat AI4CE 30 30 0 23 Feb 2022
mSLAM: Massively multilingual joint pre-training for speech and text Ankur Bapna Colin Cherry Yu Zhang Ye Jia Melvin Johnson Yong Cheng Simran Khanuja Jason Riesa Alexis Conneau VLM 30 111 0 03 Feb 2022
Linguistically-driven Multi-task Pre-training for Low-resource Neural Machine Translation Zhuoyuan Mao Chenhui Chu Sadao Kurohashi 17 6 0 20 Jan 2022
Which Student is Best? A Comprehensive Knowledge Distillation Exam for Task-Specific BERT Models Made Nindyatama Nityasya Haryo Akbarianto Wibowo Rendi Chevi Radityo Eko Prasojo Alham Fikri Aji 23 4 0 03 Jan 2022
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 81 83 0 08 Nov 2021
Continual Learning in Multilingual NMT via Language-Specific Embeddings Alexandre Berard CLL 27 20 0 20 Oct 2021
Multilingual Unsupervised Neural Machine Translation with Denoising Adapters Ahmet Üstün Alexandre Berard Laurent Besacier Matthias Gallé 25 44 0 20 Oct 2021
Breaking Down Multilingual Machine Translation Ting-Rui Chiang Yi-Pei Chen Yi-Ting Yeh Graham Neubig 27 13 0 15 Oct 2021
Multilingual Neural Machine Translation:Can Linguistic Hierarchies Help? Fahimeh Saleh Wray L. Buntine Gholamreza Haffari Lan Du 18 6 0 15 Oct 2021
Bandits Don't Follow Rules: Balancing Multi-Facet Machine Translation with Multi-Armed Bandits Julia Kreutzer David Vilar Artem Sokolov 49 15 0 13 Oct 2021
MSP: Multi-Stage Prompting for Making Pre-trained Language Models Better Translators Zhixing Tan Xiangwen Zhang Shuo Wang Yang Liu VLM LRM 213 52 0 13 Oct 2021
When Does Translation Require Context? A Data-driven, Multilingual Exploration Patrick Fernandes Kayo Yin Emmy Liu André F. T. Martins Graham Neubig 14 36 0 15 Sep 2021
Efficient Inference for Multilingual Neural Machine Translation Alexandre Berard Dain Lee S. Clinchant K. Jung Vassilina Nikoulina 54 12 0 14 Sep 2021
Multilingual Translation via Grafting Pre-trained Language Models Zewei Sun Mingxuan Wang Lei Li AI4CE 191 22 0 11 Sep 2021
A Large-Scale Study of Machine Translation in the Turkic Languages Jamshidbek Mirzakhalov A. Babu Duygu Ataman S. Kariev Francis M. Tyers ... Esra Onal Shaxnoza Pulatova Ahsan Wahab Orhan Firat Sriram Chellappan 19 28 0 09 Sep 2021
Distributionally Robust Multilingual Machine Translation Chunting Zhou Daniel Levy Xian Li Marjan Ghazvininejad Graham Neubig 80 24 0 09 Sep 2021
Competence-based Curriculum Learning for Multilingual Machine Translation Mingliang Zhang Fandong Meng Y. Tong Jie Zhou 39 16 0 09 Sep 2021
Survey of Low-Resource Machine Translation Barry Haddow Rachel Bawden Antonio Valerio Miceli Barone Jindvrich Helcl Alexandra Birch AIMat 39 150 0 01 Sep 2021
Active Learning for Massively Parallel Translation of Constrained Text into Low Resource Languages Zhong Zhou A. Waibel 14 5 0 16 Aug 2021
A Dynamic Head Importance Computation Mechanism for Neural Machine Translation Akshay Goindani Manish Shrivastava 24 4 0 03 Aug 2021
Cross-lingual Transferring of Pre-trained Contextualized Language Models Zuchao Li Kevin Parnow Hai Zhao Zhuosheng Zhang Rui Wang Masao Utiyama Eiichiro Sumita 13 8 0 27 Jul 2021
More Parameters? No Thanks! Zeeshan Khan Kartheek Akella Vinay P. Namboodiri C. V. Jawahar 27 1 0 20 Jul 2021
Neural Machine Translation for Low-Resource Languages: A Survey Surangika Ranathunga E. Lee Marjana Prifti Skenduli Ravi Shekhar Mehreen Alam Rishemjit Kaur 40 236 0 29 Jun 2021
Power Law Graph Transformer for Machine Translation and Representation Learning B. Gokden 8 2 0 27 Jun 2021
Central Kurdish machine translation: First large scale parallel corpus and experiments Zhila Amini Mohammad MohammadAmini Hawre Hosseini Mehran Mansouri Daban Q. Jaff 24 4 0 17 Jun 2021
Language Tags Matter for Zero-Shot Neural Machine Translation Liwei Wu Shanbo Cheng Mingxuan Wang Lei Li 3DV 45 36 0 15 Jun 2021
AI-enabled Automation for Completeness Checking of Privacy Policies Orlando Amaral Sallam Abualhaija Damiano Torre M. Sabetzadeh Lionel C. Briand 11 39 0 10 Jun 2021
Never guess what I heard... Rumor Detection in Finnish News: a Dataset and a Baseline Mika Hämäläinen Khalid Alnajjar N. Partanen Jack Rueter 20 7 0 07 Jun 2021
The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation Naman Goyal Cynthia Gao Vishrav Chaudhary Peng-Jen Chen Guillaume Wenzek Da Ju Sanjan Krishnan MarcÁurelio Ranzato Francisco Guzman Angela Fan 15 559 0 06 Jun 2021
Combining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Induction Jinpeng Zhang Baijun Ji Nini Xiao Xiangyu Duan Min Zhang Yangbin Shi Weihua Luo 34 22 0 06 Jun 2021
Gender Bias Hidden Behind Chinese Word Embeddings: The Case of Chinese Adjectives Meichun Jiao Ziyang Luo 11 8 0 01 Jun 2021
Beyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translation Eleftheria Briakou Marine Carpuat 13 13 0 31 May 2021
Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data Wei-Jen Ko Ahmed El-Kishky Adithya Renduchintala Vishrav Chaudhary Naman Goyal Francisco Guzmán Pascale Fung Philipp Koehn Mona T. Diab 19 41 0 31 May 2021
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads? Zae Myung Kim Laurent Besacier Vassilina Nikoulina D. Schwab MILM 55 7 0 31 May 2021
Data Augmentation for Sign Language Gloss Translation Amit Moryossef Kayo Yin Graham Neubig Yoav Goldberg SLR 13 54 0 16 May 2021
Data Augmentation by Concatenation for Low-Resource Translation: A Mystery and a Solution Toan Q. Nguyen Kenton W. Murray David Chiang 16 15 0 04 May 2021
Addressing the Vulnerability of NMT in Input Perturbations Weiwen Xu Ai Ti Aw Yang Ding Kui Wu Chenyu You AAML 29 10 0 20 Apr 2021