v1v2v3v4v5 (latest)

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 March 2020

Graham Neubig

Papers citing "XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization"

50 / 666 papers shown

Title
AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages Abteen Ebrahimi Manuel Mager Arturo Oncevay Vishrav Chaudhary Luis Chiruzzo ... Graham Neubig Alexis Palmer Rolando A. Coto Solano Ngoc Thang Vu Katharina Kann 160 74 0 18 Apr 2021
A Simple and Effective Positional Encoding for Transformers Pu-Chin Chen Henry Tsai Srinadh Bhojanapalli Hyung Won Chung Yin-Wen Chang Chun-Sung Ferng 120 66 0 18 Apr 2021
MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs Zewen Chi Li Dong Shuming Ma Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei LRM 127 74 0 18 Apr 2021
Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training Kuan-Hao Huang Wasi Uddin Ahmad Nanyun Peng Kai-Wei Chang AAML 133 34 0 17 Apr 2021
Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems E. Razumovskaia Goran Glavaš Olga Majewska Edoardo Ponti Anna Korhonen Ivan Vulić 190 34 0 17 Apr 2021
Multilingual and Cross-Lingual Intent Detection from Spoken Data D. Gerz Pei-hao Su Razvan Kusztos Avishek Mondal M. Lis Eshan Singhal N. Mrksic Tsung-Hsien Wen Ivan Vulić 79 35 0 17 Apr 2021
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation Sebastian Ruder Noah Constant Jan A. Botha Aditya Siddhant Orhan Firat ... Pengfei Liu Junjie Hu Dan Garrette Graham Neubig Melvin Johnson ELM AAML LRM 97 190 0 15 Apr 2021
ExplainaBoard: An Explainable Leaderboard for NLP Pengfei Liu Jinlan Fu Yanghua Xiao Weizhe Yuan Shuaichen Chang Junqi Dai Yixin Liu Zihuiwen Ye Zi-Yi Dou Graham Neubig XAI LRM ELM 87 55 0 13 Apr 2021
Sentiment-based Candidate Selection for NMT Alex Jones Derry Wijaya 58 2 0 10 Apr 2021
MCL@IITK at SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation using Augmented Data, Signals, and Transformers Rohan Gupta Jay Mundra Deepak Mahajan Ashutosh Modi 48 3 0 04 Apr 2021
UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training Mingyang Zhou Luowei Zhou Shuohang Wang Yu Cheng Linjie Li Zhou Yu Jingjing Liu MLLM VLM 99 92 0 01 Apr 2021
UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language Oleksiy Syvokon O. Nahorna 93 33 0 31 Mar 2021
NaijaNER : Comprehensive Named Entity Recognition for 5 Nigerian Languages W. Oyewusi Olubayo Adekanmbi Ife Okoh Vitus Onuigwe M. Salami Opeyemi Osakuade Sharon Ibejih U. Musa 63 12 0 30 Mar 2021
Are Multilingual Models Effective in Code-Switching? Genta Indra Winata Samuel Cahyawijaya Zihan Liu Zhaojiang Lin Andrea Madotto Pascale Fung 68 72 0 24 Mar 2021
NaturalProofs: Mathematical Theorem Proving in Natural Language Sean Welleck Jiacheng Liu Ronan Le Bras Hannaneh Hajishirzi Yejin Choi Kyunghyun Cho AIMat 98 69 0 24 Mar 2021
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets Julia Kreutzer Isaac Caswell Lisa Wang Ahsan Wahab D. Esch ... Duygu Ataman Orevaoghene Ahia Oghenefego Ahia Sweta Agrawal Mofetoluwa Adeyemi 76 280 0 22 Mar 2021
MasakhaNER: Named Entity Recognition for African Languages David Ifeoluwa Adelani Jade Z. Abbott Graham Neubig Daniel D'souza Julia Kreutzer ... T. Diop A. Diallo Adewale Akinfaderin T. Marengereke Salomey Osei 112 195 0 22 Mar 2021
MuRIL: Multilingual Representations for Indian Languages Simran Khanuja Diksha Bansal Sarvesh Mehtani Savya Khosla Atreyee Dey ... Shachi Dave Shruti Gupta Subhash Chandra Bose Gali Vishnu Subramanian Partha P. Talukdar 110 292 0 19 Mar 2021
Graph Convolutional Network for Swahili News Classification Alexandros Kastanos Tyler Martin GNN 71 3 0 16 Mar 2021
Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models Po-Yao (Bernie) Huang Mandela Patrick Junjie Hu Graham Neubig Florian Metze Alexander G. Hauptmann MLLM VLM 111 57 0 16 Mar 2021
Multi-view Subword Regularization Xinyi Wang Sebastian Ruder Graham Neubig 82 46 0 15 Mar 2021
LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation Xiaoqi Jiao Yichun Yin Lifeng Shang Xin Jiang Xiao Chen Linlin Li Fang Wang Qun Liu 65 9 0 11 Mar 2021
Majority Voting with Bidirectional Pre-translation For Bitext Retrieval Alex Jones Derry Wijaya 100 6 0 10 Mar 2021
Vyākarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages Rajaswa Patil Jasleen Dhillon Siddhant Mahurkar Saumitra Kulkarni M. Malhotra V. Baths 65 1 0 01 Mar 2021
Unbiased Sentence Encoder For Large-Scale Multi-lingual Search Engines Mahdi Hajiaghayi Monir Hajiaghayi Mark R. Bolin 39 0 0 01 Mar 2021
RuSentEval: Linguistic Source, Encoder Force! Vladislav Mikhailov Ekaterina Taktasheva Elina Sigdel Ekaterina Artemova VLM 43 6 0 28 Feb 2021
Bilingual Language Modeling, A transfer learning technique for Roman Urdu Usama Khalid M. O. Beg Muhammad Umair Arshad 41 3 0 22 Feb 2021
Revisiting Language Encoding in Learning Multilingual Representations Shengjie Luo Kaiyuan Gao Shuxin Zheng Guolin Ke Di He Liwei Wang Tie-Yan Liu 65 2 0 16 Feb 2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann Tosin Adewumi Karmanya Aggarwal Pawan Sasanka Ammanamanchi Aremu Anuoluwapo ... Nishant Subramani Wei Xu Diyi Yang Akhila Yerukola Jiawei Zhou VLM 323 285 0 02 Feb 2021
Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models Nora Kassner Philipp Dufter Hinrich Schütze 83 141 0 01 Feb 2021
Does Typological Blinding Impede Cross-Lingual Sharing? Johannes Bjerva Isabelle Augenstein 83 17 0 28 Jan 2021
First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT Benjamin Muller Yanai Elazar Benoît Sagot Djamé Seddah LRM 67 77 0 26 Jan 2021
Attention Can Reflect Syntactic Structure (If You Let It) Vinit Ravishankar Artur Kulmizev Mostafa Abdou Anders Søgaard Joakim Nivre 66 32 0 26 Jan 2021
Meta-Learning for Effective Multi-task and Multilingual Modelling Ishan Tarunesh Sushil Khyalia Vishwajeet Kumar Ganesh Ramakrishnan Preethi Jyothi 81 16 0 25 Jan 2021
Distilling Large Language Models into Tiny and Effective Students using pQRNN P. Kaliamoorthi Aditya Siddhant Edward Li Melvin Johnson MQ 60 17 0 21 Jan 2021
Word Alignment by Fine-tuning Embeddings on Parallel Corpora Zi-Yi Dou Graham Neubig 197 272 0 20 Jan 2021
Coarse and Fine-Grained Hostility Detection in Hindi Posts using Fine Tuned Multilingual Embeddings Arkadipta De E Venkatesh Kaushal Kumar Maurya M. Desarkar 44 7 0 13 Jan 2021
A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters Mengjie Zhao Yi Zhu Ehsan Shareghi Ivan Vulić Roi Reichart Anna Korhonen Hinrich Schütze 112 64 0 31 Dec 2020
ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora Ouyang Xuan Shuohuan Wang Chao Pang Yu Sun Hao Tian Hua Wu Haifeng Wang 144 103 0 31 Dec 2020
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models Phillip Rust Jonas Pfeiffer Ivan Vulić Sebastian Ruder Iryna Gurevych 169 256 0 31 Dec 2020
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 117 134 0 31 Dec 2020
Universal Sentence Representation Learning with Conditional Masked Language Model Ziyi Yang Yinfei Yang Daniel Cer Jax Law Eric F. Darve SSL 93 58 0 28 Dec 2020
ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic Muhammad Abdul-Mageed AbdelRahim Elmadany El Moatez Billah Nagoudi VLM 131 467 0 27 Dec 2020
Continual Lifelong Learning in Natural Language Processing: A Survey Magdalena Biesialska Katarzyna Biesialska Marta R. Costa-jussá KELM CLL 100 222 0 17 Dec 2020
WILDS: A Benchmark of in-the-Wild Distribution Shifts Pang Wei Koh Shiori Sagawa Henrik Marklund Sang Michael Xie Marvin Zhang ... A. Kundaje Emma Pierson Sergey Levine Chelsea Finn Percy Liang OOD 337 1,452 0 14 Dec 2020
Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfer M. Vidoni Ivan Vulić Goran Glavaš 105 27 0 11 Dec 2020
ParsiNLU: A Suite of Language Understanding Challenges for Persian Daniel Khashabi Arman Cohan Siamak Shakeri Pedram Hosseini Pouya Pezeshkpour ... Niloofar Safi Samghabadi Mahsa Shafaei Saber Sheybani Ali Tazarv Yadollah Yaghoobzadeh 74 44 0 11 Dec 2020
Automatically Identifying Language Family from Acoustic Examples in Low Resource Scenarios Peter Wu Yifan Zhong A. Black 44 3 0 01 Dec 2020
GLGE: A New General Language Generation Evaluation Benchmark Dayiheng Liu Yu Yan Yeyun Gong Weizhen Qi Hang Zhang ... Jiancheng Lv Ruofei Zhang Winnie Wu Ming Zhou Nan Duan ELM 115 66 0 24 Nov 2020
Multilingual AMR-to-Text Generation Angela Fan Claire Gardent 51 33 0 10 Nov 2020