Cross-lingual Transferring of Pre-trained Contextualized Language Models

27 July 2021

Rui Wang

Papers citing "Cross-lingual Transferring of Pre-trained Contextualized Language Models"

39 / 39 papers shown

Title
CLUE: A Chinese Language Understanding Evaluation Benchmark Liang Xu Hai Hu Xuanwei Zhang Lu Li Chenjie Cao ... Cong Yue Xinrui Zhang Zhen-Yi Yang Kyle Richardson Zhenzhong Lan ELM 82 383 0 13 Apr 2020
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation Yaobo Liang Nan Duan Yeyun Gong Ning Wu Fenfei Guo ... Shuguang Liu Fan Yang Daniel Fernando Campos Rangan Majumder Ming Zhou ELM VLM 77 350 0 03 Apr 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 158 970 0 24 Mar 2020
From English To Foreign Languages: Transferring Pre-trained Language Models Ke M. Tran 42 51 0 18 Feb 2020
Multilingual Alignment of Contextual Word Representations Steven Cao Nikita Kitaev Dan Klein 74 193 0 10 Feb 2020
Multilingual Denoising Pre-training for Neural Machine Translation Yinhan Liu Jiatao Gu Naman Goyal Xian Li Sergey Edunov Marjan Ghazvininejad M. Lewis Luke Zettlemoyer AI4CE AIMat 111 1,806 0 22 Jan 2020
Cross-lingual Pre-training Based Transfer for Zero-shot Neural Machine Translation Baijun Ji Zhirui Zhang Xiangyu Duan Min Zhang Boxing Chen Weihua Luo 69 67 0 03 Dec 2019
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 193 6,522 0 05 Nov 2019
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 161 793 0 25 Oct 2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 192 7,465 0 02 Oct 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 514 24,351 0 26 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 215 8,415 0 19 Jun 2019
ChID: A Large-scale Chinese IDiom Dataset for Cloze Test Chujie Zheng Minlie Huang Aixin Sun 59 87 0 04 Jun 2019
Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies Yunsu Kim Yingbo Gao Hermann Ney VLM 55 88 0 14 May 2019
An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models Alexandra Chronopoulou Christos Baziotis Alexandros Potamianos CLL 60 130 0 27 Feb 2019
Polyglot Contextual Representations Improve Crosslingual Transfer Phoebe Mulcaire Jungo Kasai Noah A. Smith 51 69 0 26 Feb 2019
Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing Tal Schuster Ori Ram Regina Barzilay Amir Globerson 68 210 0 25 Feb 2019
Parameter-Efficient Transfer Learning for NLP N. Houlsby A. Giurgiu Stanislaw Jastrzebski Bruna Morrone Quentin de Laroussilhe Andrea Gesmundo Mona Attariyan Sylvain Gelly 208 4,439 0 02 Feb 2019
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau 73 2,735 0 22 Jan 2019
A Span-Extraction Dataset for Chinese Machine Reading Comprehension Yiming Cui Ting Liu Wanxiang Che Li Xiao Zhipeng Chen Wentao Ma Shijin Wang Guoping Hu 66 186 0 17 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.4K 94,511 0 11 Oct 2018
Unsupervised Cross-lingual Transfer of Word Embedding Spaces Ruochen Xu Yiming Yang Naoki Otani Yuexin Wu SSL 41 99 0 10 Sep 2018
Trivial Transfer Learning for Low-Resource Neural Machine Translation Tom Kocmi Ondrej Bojar 57 172 0 02 Sep 2018
Improving Cross-Lingual Word Embeddings by Meeting in the Middle Yerai Doval Jose Camacho-Collados Luis Espinosa-Anke Steven Schockaert 51 60 0 27 Aug 2018
Meta-Learning for Low-Resource Neural Machine Translation Jiatao Gu Yong Wang Yun Chen Kyunghyun Cho Victor O.K. Li 74 342 0 25 Aug 2018
Rapid Adaptation of Neural Machine Translation to New Languages Graham Neubig Junjie Hu AI4CE 60 209 0 13 Aug 2018
A Full End-to-End Semantic Role Labeler, Syntax-agnostic Over Syntax-aware? Jiaxun Cai Shexia He Z. Li Zhao Hai 54 77 0 11 Aug 2018
When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation? Ye Qi Devendra Singh Sachan Matthieu Felix Sarguna Padmanabhan Graham Neubig 90 343 0 17 Apr 2018
Learning Word Vectors for 157 Languages Edouard Grave Piotr Bojanowski Prakhar Gupta Armand Joulin Tomas Mikolov SSL FaML 93 1,425 0 19 Feb 2018
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 284 1,655 0 11 Oct 2017
Transfer Learning across Low-Resource, Related Languages for Neural Machine Translation Toan Q. Nguyen David Chiang 65 210 0 31 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 624 130,942 0 12 Jun 2017
Deep Biaffine Attention for Neural Dependency Parsing Timothy Dozat Christopher D. Manning 108 1,221 0 06 Nov 2016
Enriching Word Vectors with Subword Information Piotr Bojanowski Edouard Grave Armand Joulin Tomas Mikolov NAI SSL VLM 209 9,953 0 15 Jul 2016
Transfer Learning for Low-Resource Neural Machine Translation Barret Zoph Deniz Yuret Jonathan May Kevin Knight 76 853 0 08 Apr 2016
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 306 19,580 0 09 Mar 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.4K 149,842 0 22 Dec 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 501 27,263 0 01 Sep 2014
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 623 31,469 0 16 Jan 2013