When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?

17 April 2018

Ye Qi

Devendra Singh Sachan

Matthieu Felix

Sarguna Padmanabhan

Graham Neubig

ArXiv PDF HTML

Papers citing "When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?"

50 / 203 papers shown

Title
CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB Holger Schwenk Guillaume Wenzek Sergey Edunov Edouard Grave Armand Joulin 30 256 0 10 Nov 2019
CCAligned: A Massive Collection of Cross-Lingual Web-Document Pairs Ahmed El-Kishky Vishrav Chaudhary Francisco Guzman Philipp Koehn 20 198 0 10 Nov 2019
Should All Cross-Lingual Embeddings Speak English? Antonios Anastasopoulos Graham Neubig 19 31 0 08 Nov 2019
Word Embedding Algorithms as Generalized Low Rank Models and their Canonical Form Kian Kenyon-Dean 27 3 0 06 Nov 2019
Masked Language Model Scoring Julian Salazar Davis Liang Toan Q. Nguyen Katrin Kirchhoff 19 13 0 31 Oct 2019
Adapting Multilingual Neural Machine Translation to Unseen Languages Surafel Melaku Lakew Alina Karakanta Marcello Federico Matteo Negri Marco Turchi 36 20 0 30 Oct 2019
Transformers without Tears: Improving the Normalization of Self-Attention Toan Q. Nguyen Julian Salazar 38 224 0 14 Oct 2019
Riposte! A Large Corpus of Counter-Arguments Paul Reisert Benjamin Heinzerling Naoya Inoue Shun Kiyono Kentaro Inui HAI LRM 16 2 0 08 Oct 2019
On Dimensional Linguistic Properties of the Word Embedding Space Maosen Li Siheng Chen Ya Zhang Florian Metze 20 3 0 05 Oct 2019
A Universal Parent Model for Low-Resource Neural Machine Translation Transfer Mozhdeh Gheini Jonathan May 16 21 0 14 Sep 2019
VizSeq: A Visual Analysis Toolkit for Text Generation Tasks Changhan Wang Anirudh Jain Danlu Chen Jiatao Gu 8 29 0 12 Sep 2019
Dynamic Fusion: Attentional Language Model for Neural Machine Translation Michiki Kurosawa Mamoru Komachi 19 0 0 11 Sep 2019
Transformer to CNN: Label-scarce distillation for efficient text classification Yew Ken Chia Sam Witteveen Martin Andrews 11 37 0 08 Sep 2019
Neural Machine Translation with Byte-Level Subwords Changhan Wang Kyunghyun Cho Jiatao Gu 26 173 0 07 Sep 2019
Bilingual Lexicon Induction with Semi-supervision in Non-Isometric Embedding Spaces Barun Patra Joel Ruben Antony Moniz Sarthak Garg Matthew R. Gormley Graham Neubig 31 100 0 19 Aug 2019
Language Graph Distillation for Low-Resource Machine Translation Tianyu He Jiale Chen Xu Tan Tao Qin 11 7 0 17 Aug 2019
Towards Making the Most of BERT in Neural Machine Translation Jiacheng Yang Mingxuan Wang Hao Zhou Chengqi Zhao Yong Yu Weinan Zhang Lei Li CLL 18 156 0 15 Aug 2019
Exploring the Robustness of NMT Systems to Nonsensical Inputs Akshay Chaturvedi K. Abijith Utpal Garain AAML 24 12 0 03 Aug 2019
Fusing location and text features for sentiment classification W. L. Lim C. Ho Choo-Yee Ting 14 0 0 28 Jul 2019
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges N. Arivazhagan Ankur Bapna Orhan Firat Dmitry Lepikhin Melvin Johnson ... George F. Foster Colin Cherry Wolfgang Macherey Z. Chen Yonghui Wu 37 423 0 11 Jul 2019
WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia Holger Schwenk Vishrav Chaudhary Shuo Sun Hongyu Gong Francisco Guzmán CVBM 26 401 0 10 Jul 2019
The Impact of Preprocessing on Arabic-English Statistical and Neural Machine Translation Mai Oudah Amjad Almahairi Nizar Habash 30 34 0 27 Jun 2019
Evaluating the Supervised and Zero-shot Performance of Multi-lingual Translation Models Chris Hokamp John Glover D. Ghalandari 21 14 0 24 Jun 2019
Generalized Data Augmentation for Low-Resource Translation Mengzhou Xia X. Kong Antonios Anastasopoulos Graham Neubig 18 119 0 10 Jun 2019
Unsupervised Pivot Translation for Distant Languages Yichong Leng Xu Tan Tao Qin Xiang-Yang Li Tie-Yan Liu 33 30 0 06 Jun 2019
Choosing Transfer Languages for Cross-Lingual Learning Yu-Hsiang Lin Chian-Yu Chen Jean Lee Zirui Li Yuyan Zhang ... Zhisong Zhang Xuezhe Ma Antonios Anastasopoulos Patrick Littell Graham Neubig 21 231 0 29 May 2019
Debiasing Word Embeddings Improves Multimodal Machine Translation Tosho Hirasawa Mamoru Komachi 14 6 0 24 May 2019
A Call for Prudent Choice of Subword Merge Operations in Neural Machine Translation Shuoyang Ding Adithya Renduchintala Kevin Duh 13 63 0 24 May 2019
Target Conditioned Sampling: Optimizing Data Selection for Multilingual Neural Machine Translation Xinyi Wang Graham Neubig 25 26 0 20 May 2019
Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies Yunsu Kim Yingbo Gao Hermann Ney VLM 24 88 0 14 May 2019
Using Multi-Sense Vector Embeddings for Reverse Dictionaries Michael A. Hedderich Andrew Yates Dietrich Klakow Gerard de Melo 25 20 0 02 Apr 2019
Multimodal Machine Translation with Embedding Prediction Tosho Hirasawa Hayahide Yamagishi Yukio Matsumura Mamoru Komachi 21 16 0 01 Apr 2019
Learning semantic sentence representations from visually grounded language without lexical knowledge Danny Merkx S. Frank SSL 19 13 0 27 Mar 2019
compare-mt: A Tool for Holistic Comparison of Language Generation Systems Graham Neubig Zi-Yi Dou Junjie Hu Paul Michel Danish Pruthi Xinyi Wang John Wieting ELM 19 114 0 19 Mar 2019
Massively Multilingual Neural Machine Translation Roee Aharoni Melvin Johnson Orhan Firat LRM AI4CE 17 482 0 28 Feb 2019
Multilingual Neural Machine Translation with Knowledge Distillation Xu Tan Yi Ren Di He Tao Qin Zhou Zhao Tie-Yan Liu 20 248 0 27 Feb 2019
Improving Robustness of Machine Translation with Synthetic Noise Vaibhav Sumeet Singh Craig Alan Stewart Graham Neubig 18 83 0 25 Feb 2019
Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing Tal Schuster Ori Ram Regina Barzilay Amir Globerson 39 208 0 25 Feb 2019
PAC-Bayes Analysis of Sentence Representation Kento Nozawa Issei Sato 24 3 0 12 Feb 2019
Multilingual Neural Machine Translation With Soft Decoupled Encoding Xinyi Wang Hieu H. Pham Philip Arthur Graham Neubig 13 59 0 09 Feb 2019
Equalizing Gender Biases in Neural Machine Translation with Word Embeddings Techniques Joel Escudé Font Marta R. Costa-jussá 18 168 0 10 Jan 2019
Transfer Learning in Multilingual Neural Machine Translation with Dynamic Vocabulary Surafel Melaku Lakew A. Erofeeva Matteo Negri Marcello Federico Marco Turchi 21 62 0 03 Nov 2018
Unsupervised Neural Text Simplification S. Surya Abhijit Mishra Anirban Laha Parag Jain Karthik Sankaranarayanan 26 86 0 18 Oct 2018
Parameter Sharing Methods for Multilingual Self-Attentional Translation Models Devendra Singh Sachan Graham Neubig MoE 42 114 0 01 Sep 2018
Context Mover's Distance & Barycenters: Optimal Transport of Contexts for Building Representations Sidak Pal Singh Andreas Hug Aymeric Dieuleveut Martin Jaggi OT 33 26 0 29 Aug 2018
Adapting Word Embeddings to New Languages with Morphological and Phonological Subword Representations Aditi Chaudhary Chunting Zhou Lori S. Levin Graham Neubig David R. Mortensen J. Carbonell 17 62 0 28 Aug 2018
Rapid Adaptation of Neural Machine Translation to New Languages Graham Neubig Junjie Hu AI4CE 15 208 0 13 Aug 2018
Training Neural Machine Translation using Word Embedding-based Loss Katsuki Chousa Katsuhito Sudoh Satoshi Nakamura 33 11 0 30 Jul 2018
Effective Use of Bidirectional Language Modeling for Transfer Learning in Biomedical Named Entity Recognition Devendra Singh Sachan P. Xie Mrinmaya Sachan Eric Xing MedIm 27 56 0 21 Nov 2017
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 189 1,639 0 11 Oct 2017