v1v2v3v4v5 (latest)

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 March 2020

Graham Neubig

Papers citing "XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization"

50 / 666 papers shown

Title
Crosslingual Retrieval Augmented In-context Learning for Bangla Xiaoqian Li Ercong Nie Sheng Liang RALM LRM 85 8 0 01 Nov 2023
EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learning Ping Guo Xiangpeng Wei Yue Hu Baosong Yang Dayiheng Liu Fei Huang Jun Xie 70 2 0 26 Oct 2023
X-SNS: Cross-Lingual Transfer Prediction through Sub-Network Similarity Taejun Yun Jinhyeon Kim Deokyeong Kang Seong Hoon Lim Jihoon Kim Taeuk Kim 86 0 0 26 Oct 2023
A Multilingual Virtual Guide for Self-Attachment Technique Alicia Jiayun Law Ruoyu Hu Lisa Alazraki Anandha Gopalan Neophytos Polydorou A. Edalat 43 3 0 25 Oct 2023
XFEVER: Exploring Fact Verification across Languages Yi-Chen Chang Canasai Kruengkrai Junichi Yamagishi HILM 35 3 0 25 Oct 2023
A Joint Matrix Factorization Analysis of Multilingual Representations Zheng Zhao Yftah Ziser Bonnie Webber Shay B. Cohen 87 4 0 24 Oct 2023
GradSim: Gradient-Based Language Grouping for Effective Multilingual Training Mingyang Wang Heike Adel Lukas Lange Jannik Strötgen Hinrich Schütze 86 4 0 23 Oct 2023
Breaking the Language Barrier: Improving Cross-Lingual Reasoning with Structured Self-Attention Negar Foroutan Mohammadreza Banaei Karl Aberer Antoine Bosselut LRM 65 5 0 23 Oct 2023
The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languages Chiyu Zhang Khai Duy Doan Qisheng Liao Muhammad Abdul-Mageed 72 6 0 23 Oct 2023
A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systems Songbo Hu Han Zhou Moy Yuan Milan Gritta Guchun Zhang Ignacio Iacobacci Anna Korhonen Ivan Vulić 86 3 0 19 Oct 2023
One For All & All For One: Bypassing Hyperparameter Tuning with Model Averaging For Cross-Lingual Transfer Fabian David Schmidt Ivan Vulić Goran Glavaš MoMe 44 4 0 16 Oct 2023
Crosslingual Structural Priming and the Pre-Training Dynamics of Bilingual Language Models Catherine Arnett Tyler A. Chang J. Michaelov Benjamin Bergen 43 0 0 11 Oct 2023
Unleashing the Multilingual Encoder Potential: Boosting Zero-Shot Performance via Probability Calibration Ercong Nie Helmut Schmid Hinrich Schütze UQCV 101 2 0 08 Oct 2023
Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLU Fajri Koto Nurul Aisyah Haonan Li Timothy Baldwin AI4Ed LRM ELM 104 46 0 07 Oct 2023
A Brief History of Prompt: Leveraging Language Models. (Through Advanced Prompting) G. Muktadir SILM 52 10 0 30 Sep 2023
Self-Augmentation Improves Zero-Shot Cross-Lingual Transfer Fei Wang Kuan-Hao Huang Kai-Wei Chang Muhao Chen 71 5 0 19 Sep 2023
NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages Samuel Cahyawijaya Holy Lovenia Fajri Koto Dea Adhista Emmanuel Dave ... Genta Indra Winata David Moeljadi Alham Fikri Aji Ayu Purwarianti Pascale Fung 87 9 0 19 Sep 2023
OpenMSD: Towards Multilingual Scientific Documents Similarity Measurement Yang Gao Ji Ma I. Korotkov Keith B. Hall Dana Alon Donald Metzler 57 0 0 19 Sep 2023
Contextual Label Projection for Cross-Lingual Structured Prediction Tanmay Parekh I-Hung Hsu Kuan-Hao Huang Kai-Wei Chang Nanyun Peng 73 5 0 16 Sep 2023
Leveraging Multi-lingual Positive Instances in Contrastive Learning to Improve Sentence Embedding Kaiyan Zhao Qiyu Wu Xin-Qiang Cai Yoshimasa Tsuruoka 42 8 0 16 Sep 2023
SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects David Ifeoluwa Adelani Hannah Liu Xiaoyu Shen Nikita Vassilyev Jesujoba Oluwadara Alabi Yanke Mao Haonan Gao Annie En-Shiun Lee ELM 102 80 0 14 Sep 2023
BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Models Wei Qi Leong Jian Gang Ngui Yosephine Susanto Hamsawardhini Rengarajan Kengatharaiyer Sarveswaran William-Chandra Tjhi 74 9 0 12 Sep 2023
MADLAD-400: A Multilingual And Document-Level Large Audited Dataset Sneha Kudugunta Isaac Caswell Biao Zhang Xavier Garcia Christopher A. Choquette-Choo ... Derrick Xin Aditya Kusupati Romi Stella Ankur Bapna Orhan Firat 134 141 0 09 Sep 2023
Multiple Representation Transfer from Large Language Models to End-to-End ASR Systems Takuma Udagawa Masayuki Suzuki Gakuto Kurata Masayasu Muraoka G. Saon 85 2 0 07 Sep 2023
Multilingual Text Representation Fahim Faisal 58 0 0 02 Sep 2023
mCL-NER: Cross-Lingual Named Entity Recognition via Multi-view Contrastive Learning Ying Mo Jian Yang Jiahao Liu Qifan Wang Ruoyu Chen Jingang Wang Zhoujun Li 68 28 0 17 Aug 2023
Factuality Detection using Machine Translation -- a Use Case for German Clinical Text Mohammed Mustafa Ahmed Bin Sumait Aleksandra Gabryszak Leonhard Hennig Roland Roller MedIm HILM 77 0 0 17 Aug 2023
A User-Centered Evaluation of Spanish Text Simplification Adrian de Wynter Anthony Hevia Si-Qing Chen 66 0 0 15 Aug 2023
Cross-Lingual Constituency Parsing for Middle High German: A Delexicalized Approach Ercong Nie Helmut Schmid Hinrich Schütze 60 1 0 09 Aug 2023
Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback Viet Dac Lai Chien Van Nguyen Nghia Trung Ngo Thuat Nguyen Franck Dernoncourt Ryan Rossi Thien Huu Nguyen ALM 138 150 0 29 Jul 2023
Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems Songbo Hu Han Zhou Mete Hergul Milan Gritta Guchun Zhang Ignacio Iacobacci Ivan Vulić Anna Korhonen 97 12 0 26 Jul 2023
A Dataset and Strong Baselines for Classification of Czech News Texts Hynek Kydlívcek Jindrich Libovický 42 1 0 20 Jul 2023
Gradient Sparsification For Masked Fine-Tuning of Transformers J. Ó. Neill Sourav Dutta 53 0 0 19 Jul 2023
Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language Understanding Bolei Ma Ercong Nie Helmut Schmid Hinrich Schütze AAML VLM LRM 97 9 0 15 Jul 2023
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features Ester Hlavnova Sebastian Ruder 84 5 0 11 Jul 2023
Enhancing Cross-lingual Transfer via Phonemic Transcription Integration Hoang Nguyen Chenwei Zhang Tao Zhang Eugene Rohrbaugh Philip S. Yu 78 7 0 10 Jul 2023
Optimal Transport Posterior Alignment for Cross-lingual Semantic Parsing Tom Sherborne Tom Hosking Mirella Lapata OT 82 4 0 09 Jul 2023
Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages Yasmine Karoui R. Lebret Negar Foroutan Karl Aberer MLLM VLM 64 2 0 29 Jun 2023
SkillNet-X: A Multilingual Multitask Model with Sparsely Activated Skills Zhangyin Feng Yong Dai Fan Zhang Duyu Tang Xiaocheng Feng Shuangzhi Wu Bing Qin Yunbo Cao Shuming Shi MoE 58 0 0 28 Jun 2023
Cross-Lingual Cross-Age Group Adaptation for Low-Resource Elderly Speech Emotion Recognition Samuel Cahyawijaya Holy Lovenia Willy Chung Rita Frieske Zihan Liu Pascale Fung 108 1 0 26 Jun 2023
L3Cube-MahaSent-MD: A Multi-domain Marathi Sentiment Analysis Dataset and Transformer Models Aabha Pingle Aditya Vyawahare Isha Joshi Rahul Tangsali Raviraj Joshi 62 9 0 24 Jun 2023
Apolitical Intelligence? Auditing Delphi's responses on controversial political issues in the US J. H. Rystrøm 58 0 0 22 Jun 2023
Recipes for Sequential Pre-training of Multilingual Encoder and Seq2Seq Models Saleh Soltan Andrew Rosenbaum Tobias Falke Qin Lu Anna Rumshisky Wael Hamza 73 1 0 14 Jun 2023
Babel-ImageNet: Massively Multilingual Evaluation of Vision-and-Language Representations Gregor Geigle Radu Timofte Goran Glavaš VLM MLLM 61 5 0 14 Jun 2023
Massively Multilingual Corpus of Sentiment Datasets and Multi-faceted Sentiment Classification Benchmark Lukasz Augustyniak Szymon Wo'zniak Marcin Gruza Piotr Gramacki Krzysztof Rajda M. Morzy Tomasz Kajdanowicz 68 7 0 13 Jun 2023
Soft Language Clustering for Multilingual Model Pre-training Jiali Zeng Yu Jiang Yongjing Yin Yingqi Jing Fandong Meng Binghuai Lin Yunbo Cao Jie Zhou 55 4 0 13 Jun 2023
Multi-Source Test-Time Adaptation as Dueling Bandits for Extractive Question Answering Hai Ye Qizhe Xie Hwee Tou Ng 90 8 0 11 Jun 2023
Language Versatilists vs. Specialists: An Empirical Revisiting on Multilingual Transfer Ability Jiacheng Ye Xijia Tao Lingpeng Kong LRM 77 27 0 11 Jun 2023
M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining Large Language Models Wenxuan Zhang Sharifah Mahani Aljunied Chang Gao Yew Ken Chia Lidong Bing ELM 134 87 0 08 Jun 2023
T3L: Translate-and-Test Transfer Learning for Cross-Lingual Text Classification Inigo Jauregi Unanue Gholamreza Haffari Massimo Piccardi VLM 59 11 0 08 Jun 2023