Can Monolingual Pretrained Models Help Cross-Lingual Classification?

10 November 2019

Papers citing "Can Monolingual Pretrained Models Help Cross-Lingual Classification?"

22 / 22 papers shown

Title
Zero-shot Cross-lingual Transfer without Parallel Corpus Yuyang Zhang Xiaofeng Han Baojun Wang VLM 44 0 0 07 Oct 2023
Language Contamination Helps Explain the Cross-lingual Capabilities of English Pretrained Models Terra Blevins Luke Zettlemoyer 60 87 0 17 Apr 2022
Cross-Lingual Text Classification with Multilingual Distillation and Zero-Shot-Aware Training Ziqing Yang Yiming Cui Zhigang Chen Shijin Wang VLM 99 3 0 28 Feb 2022
On the Universality of Deep Contextual Language Models Shaily Bhatt Poonam Goyal Sandipan Dandapat Monojit Choudhury Sunayana Sitaram ELM 43 5 0 15 Sep 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 65 75 0 01 Jul 2021
Transferring Monolingual Model to Low-Resource Language: The Case of Tigrinya Abrhalei Tela Abraham Woubie Ville Hautamaki 46 12 0 13 Jun 2020
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 158 6,496 0 05 Nov 2019
Cross-Lingual Natural Language Generation via Pre-Training Zewen Chi Li Dong Furu Wei Wenhui Wang Xian-Ling Mao Heyan Huang 46 136 0 23 Sep 2019
MultiFiT: Efficient Multi-lingual Language Model Fine-tuning Julian Martin Eisenschlos Sebastian Ruder Piotr Czapla Marcin Kardas Sylvain Gugger Jeremy Howard 44 99 0 10 Sep 2019
Adversarial Learning with Contextual Embeddings for Zero-resource Cross-lingual Classification and NER Phillip Keung Y. Lu Vikas Bhardwaj 55 81 0 31 Aug 2019
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges N. Arivazhagan Ankur Bapna Orhan Firat Dmitry Lepikhin Melvin Johnson ... George F. Foster Colin Cherry Wolfgang Macherey Zhiwen Chen Yonghui Wu 58 424 0 11 Jul 2019
How multilingual is Multilingual BERT? Telmo Pires Eva Schlinger Dan Garrette LRM VLM 133 1,392 0 04 Jun 2019
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT Shijie Wu Mark Dredze VLM SSeg 59 675 0 19 Apr 2019
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau 54 2,727 0 22 Jan 2019
Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond Mikel Artetxe Holger Schwenk 3DV 103 1,008 0 26 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 951 93,936 0 11 Oct 2018
XNLI: Evaluating Cross-lingual Sentence Representations Alexis Conneau Guillaume Lample Ruty Rinott Adina Williams Samuel R. Bowman Holger Schwenk Veselin Stoyanov ELM 53 1,366 0 13 Sep 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 443 129,831 0 12 Jun 2017
Cross-lingual Distillation for Text Classification Ruochen Xu Yiming Yang VLM 54 71 0 05 May 2017
Adversarial Deep Averaging Networks for Cross-Lingual Sentiment Classification Xilun Chen Yu Sun Ben Athiwaratkun Claire Cardie Kilian Q. Weinberger 250 315 0 06 Jun 2016
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 155 7,683 0 31 Aug 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 236 19,523 0 09 Mar 2015