XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 March 2020

Graham Neubig

Papers citing "XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization"

50 / 661 papers shown

Title
Cross-Lingual Fine-Grained Entity Typing N. Selvaraj Yasumasa Onoe Greg Durrett 19 2 0 15 Oct 2021
OpenHands: Making Sign Language Recognition Accessible with Pose-based Pretrained Models across Languages Prem Selvaraj Gokul Nc Pratyush Kumar Mitesh Khapra VLM SLR 58 53 0 12 Oct 2021
Balancing Average and Worst-case Accuracy in Multitask Learning Paul Michel Sebastian Ruder Dani Yogatama 21 11 0 12 Oct 2021
Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddings Sawsan Alqahtani Garima Lalwani Yi Zhang Salvatore Romeo Saab Mansour OT 37 25 0 06 Oct 2021
Pretrained Transformers for Offensive Language Identification in Tanglish Sean Benhur Kanchana Sivanraju VLM 53 5 0 06 Oct 2021
Analyzing the Effects of Reasoning Types on Cross-Lingual Transfer Performance Karthikeyan K Aalok Sathe Somak Aditya Monojit Choudhury LRM 39 10 0 05 Oct 2021
Multilingual AMR Parsing with Noisy Knowledge Distillation Deng Cai Xin Li Jackie Chun-Sing Ho Lidong Bing W. Lam 27 18 0 30 Sep 2021
Call Larisa Ivanovna: Code-Switching Fools Multilingual NLU Models Alexey Birshert Ekaterina Artemova 45 2 0 29 Sep 2021
Cross-lingual Intermediate Fine-tuning improves Dialogue State Tracking Nikita Moghe Mark Steedman Alexandra Birch 33 13 0 28 Sep 2021
Monolingual and Cross-Lingual Acceptability Judgments with the Italian CoLA corpus Daniela Trotta R. Guarasci Elisa Leonardelli Sara Tonelli 44 30 0 24 Sep 2021
Cross-Lingual Language Model Meta-Pretraining Zewen Chi Heyan Huang Luyang Liu Yu Bai Xian-Ling Mao LRM 103 0 0 23 Sep 2021
Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents Biao Zhang Ankur Bapna Melvin Johnson A. Dabirmoghaddam N. Arivazhagan Orhan Firat 34 12 0 21 Sep 2021
Multi-Task Learning in Natural Language Processing: An Overview Shijie Chen Yu Zhang Qiang Yang AIMat 46 99 0 19 Sep 2021
DuRecDial 2.0: A Bilingual Parallel Corpus for Conversational Recommendation Zeming Liu Haifeng Wang Zheng-Yu Niu Hua Wu Wanxiang Che 23 56 0 18 Sep 2021
Locating Language-Specific Information in Contextualized Embeddings Sheng Liang Philipp Dufter Hinrich Schütze 30 7 0 16 Sep 2021
Translation Transformers Rediscover Inherent Data Domains Maksym Del Elizaveta Korotkova Mark Fishel 13 7 0 16 Sep 2021
Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training Bo Zheng Li Dong Shaohan Huang Saksham Singhal Wanxiang Che Ting Liu Xia Song Furu Wei VLM 21 22 0 15 Sep 2021
On the Universality of Deep Contextual Language Models Shaily Bhatt Poonam Goyal Sandipan Dandapat Monojit Choudhury Sunayana Sitaram ELM 25 5 0 15 Sep 2021
On the Language-specificity of Multilingual BERT and the Impact of Fine-tuning Marc Tanti Lonneke van der Plas Claudia Borg Albert Gatt 20 10 0 14 Sep 2021
Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction M. Yarmohammadi Shijie Wu Marc Marone Haoran Xu Seth Ebner ... Craig Harman Kenton W. Murray Aaron Steven White Mark Dredze Benjamin Van Durme 31 28 0 14 Sep 2021
Improving Zero-shot Cross-lingual Transfer between Closely Related Languages by injecting Character-level Noise Noëmi Aepli Rico Sennrich 31 17 0 14 Sep 2021
xGQA: Cross-Lingual Visual Question Answering Jonas Pfeiffer Gregor Geigle Aishwarya Kamath Jan-Martin O. Steitz Stefan Roth Ivan Vulić Iryna Gurevych 42 56 0 13 Sep 2021
Wine is Not v i n. -- On the Compatibility of Tokenizations Across Languages Antonis Maronikolakis Philipp Dufter Hinrich Schütze 24 17 0 13 Sep 2021
Efficient Test Time Adapter Ensembling for Low-resource Language Varieties Xinyi Wang Yulia Tsvetkov Sebastian Ruder Graham Neubig 38 35 0 10 Sep 2021
A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations Ziyi Yang Yinfei Yang Daniel Cer Eric F. Darve 35 23 0 10 Sep 2021
AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languages Machel Reid Junjie Hu Graham Neubig Y. Matsuo 77 31 0 10 Sep 2021
Subword Mapping and Anchoring across Languages Giorgos Vernikos Andrei Popescu-Belis 70 12 0 09 Sep 2021
Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Data Massimo Nicosia Zhongdi Qu Yasemin Altun 27 26 0 09 Sep 2021
Discrete and Soft Prompting for Multilingual Models Mengjie Zhao Hinrich Schütze LRM 18 71 0 08 Sep 2021
Similarity of Sentence Representations in Multilingual LMs: Resolving Conflicting Literature and Case Study of Baltic Languages Maksym Del Mark Fishel 16 4 0 02 Sep 2021
MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfer Ilias Chalkidis Manos Fergadiotis Ion Androutsopoulos AILaw 27 107 0 02 Sep 2021
Discovering Representation Sprachbund For Multilingual Pre-Training Yiming Fan Yaobo Liang Alexandre Muzio Hany Hassan Houqiang Li Ming Zhou Nan Duan 39 9 0 01 Sep 2021
Aligning Cross-lingual Sentence Representations with Dual Momentum Contrast Liang Wang Wei Zhao Jingming Liu 40 14 0 01 Sep 2021
Boosting Cross-Lingual Transfer via Self-Learning with Uncertainty Estimation Liyan Xu Xuchao Zhang Xujiang Zhao Haifeng Chen F. Chen Jinho Choi 28 14 0 01 Sep 2021
AraT5: Text-to-Text Transformers for Arabic Language Generation El Moatez Billah Nagoudi AbdelRahim Elmadany Muhammad Abdul-Mageed 92 118 0 31 Aug 2021
MTG: A Benchmark Suite for Multilingual Text Generation Yiran Chen Zhenqiao Song Xianze Wu Danqing Wang Jingjing Xu Jiaze Chen Hao Zhou Lei Li LRM VLM 40 22 0 13 Aug 2021
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha VLM LM&MA 26 261 0 12 Aug 2021
Compositional Generalization in Multilingual Semantic Parsing over Wikidata Ruixiang Cui Rahul Aralikatte Heather Lent Daniel Hershcovich 42 11 0 07 Aug 2021
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining Machel Reid Mikel Artetxe VLM 50 26 0 04 Aug 2021
Cross-lingual Transferring of Pre-trained Contextualized Language Models Zuchao Li Kevin Parnow Hai Zhao ZhuoSheng Zhang Rui Wang Masao Utiyama Eiichiro Sumita 13 8 0 27 Jul 2021
Modelling Latent Translations for Cross-Lingual Transfer Edoardo Ponti Julia Kreutzer Ivan Vulić Siva Reddy 34 18 0 23 Jul 2021
The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding Archiki Prasad Mohammad Ali Rehan Shreyasi Pathak Preethi Jyothi 27 9 0 21 Jul 2021
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning Paul Pu Liang Yiwei Lyu Xiang Fan Zetian Wu Yun Cheng ... Peter Wu Michelle A. Lee Yuke Zhu Ruslan Salakhutdinov Louis-Philippe Morency VLM 32 159 0 15 Jul 2021
The Benchmark Lottery Mostafa Dehghani Yi Tay A. Gritsenko Zhe Zhao N. Houlsby Fernando Diaz Donald Metzler Oriol Vinyals 42 89 0 14 Jul 2021
Improving Low-resource Reading Comprehension via Cross-lingual Transposition Rethinking Gaochen Wu Bin Xu Yuxin Qin Fei Kong Bangchang Liu Hongwen Zhao Dejie Chang 25 3 0 11 Jul 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 43 74 0 01 Jul 2021
Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer Iulia Turc Kenton Lee Jacob Eisenstein Ming-Wei Chang Kristina Toutanova 26 58 0 30 Jun 2021
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA Zewen Chi Shaohan Huang Li Dong Shuming Ma Bo Zheng ... Payal Bajaj Xia Song Xian-Ling Mao Heyan Huang Furu Wei 56 119 0 30 Jun 2021
Neural Machine Translation for Low-Resource Languages: A Survey Surangika Ranathunga E. Lee Marjana Prifti Skenduli Ravi Shekhar Mehreen Alam Rishemjit Kaur 42 237 0 29 Jun 2021
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization Yi Tay Vinh Q. Tran Sebastian Ruder Jai Gupta Hyung Won Chung Dara Bahri Zhen Qin Simon Baumgartner Cong Yu Donald Metzler 51 153 0 23 Jun 2021