v1v2v3v4v5 (latest)

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 March 2020

Graham Neubig

Papers citing "XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization"

50 / 666 papers shown

Title
The Benchmark Lottery Mostafa Dehghani Yi Tay A. Gritsenko Zhe Zhao N. Houlsby Fernando Diaz Donald Metzler Oriol Vinyals 119 92 0 14 Jul 2021
Improving Low-resource Reading Comprehension via Cross-lingual Transposition Rethinking Gaochen Wu Bin Xu Yuxin Qin Fei Kong Bangchang Liu Hongwen Zhao Dejie Chang 134 3 0 11 Jul 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 121 76 0 01 Jul 2021
Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer Iulia Turc Kenton Lee Jacob Eisenstein Ming-Wei Chang Kristina Toutanova 49 58 0 30 Jun 2021
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA Zewen Chi Shaohan Huang Li Dong Shuming Ma Bo Zheng ... Payal Bajaj Xia Song Xian-Ling Mao Heyan Huang Furu Wei 111 121 0 30 Jun 2021
Neural Machine Translation for Low-Resource Languages: A Survey Surangika Ranathunga E. Lee Marjana Prifti Skenduli Ravi Shekhar Mehreen Alam Rishemjit Kaur 126 251 0 29 Jun 2021
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization Yi Tay Vinh Q. Tran Sebastian Ruder Jai Gupta Hyung Won Chung Dara Bahri Zhen Qin Simon Baumgartner Cong Yu Donald Metzler 175 162 0 23 Jun 2021
It's All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense Reasoning Alexey Tikhonov Max Ryabinin LRM 57 64 0 22 Jun 2021
Phrase-level Active Learning for Neural Machine Translation Junjie Hu Graham Neubig AI4CE 122 13 0 21 Jun 2021
Transformers for Headline Selection for Russian News Clusters Pavel Voropaev Olga Sopilnyak 38 0 0 19 Jun 2021
GEM: A General Evaluation Benchmark for Multimodal Tasks Lin Su Nan Duan Edward Cui Lei Ji Chenfei Wu Huaishao Luo Yongfei Liu Ming Zhong Taroon Bharti Arun Sacheti VLM 112 19 0 18 Jun 2021
X-FACT: A New Benchmark Dataset for Multilingual Fact Checking Ashim Gupta Vivek Srikumar HILM 102 100 0 17 Jun 2021
Automatic Construction of Evaluation Suites for Natural Language Generation Datasets Simon Mille Kaustubh D. Dhole Saad Mahamood Laura Perez-Beltrachini Varun Gangal Mihir Kale Emiel van Miltenburg Sebastian Gehrmann ELM 87 23 0 16 Jun 2021
Consistency Regularization for Cross-Lingual Fine-Tuning Bo Zheng Li Dong Shaohan Huang Wenhui Wang Zewen Chi Saksham Singhal Wanxiang Che Ting Liu Xia Song Furu Wei 60 58 0 15 Jun 2021
Challenges and Considerations with Code-Mixed NLP for Multilingual Societies Vivek Srivastava M. Singh 83 5 0 15 Jun 2021
Modeling Profanity and Hate Speech in Social Media with Semantic Subspaces Vanessa Hahn Dana Ruiter Thomas Kleinbauer Dietrich Klakow 47 7 0 14 Jun 2021
Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning Bill Yuchen Lin Seyeon Lee Xiaoyang Qiao Xiang Ren ReLM LRM 78 63 0 13 Jun 2021
Assessing Multilingual Fairness in Pre-trained Multimodal Representations Jialu Wang Yang Liu Xinze Wang EGVM 102 37 0 12 Jun 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 121 70 0 11 Jun 2021
A Discussion on Building Practical NLP Leaderboards: The Case of Machine Translation Sebastin Santy Prasanta Bhattacharya LLMAG 88 3 0 11 Jun 2021
Learning Multilingual Representation for Natural Language Understanding with Enhanced Cross-Lingual Supervision Yinpeng Guo Liangyou Li Xin Jiang Qun Liu 55 0 0 09 Jun 2021
Probing Multilingual Language Models for Discourse Murathan Kurfali Robert Östling 76 17 0 09 Jun 2021
VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation Linjie Li Jie Lei Zhe Gan Licheng Yu Yen-Chun Chen ... Tamara L. Berg Joey Tianyi Zhou Jingjing Liu Lijuan Wang Zicheng Liu VLM 119 103 0 08 Jun 2021
Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study Yash Khemchandani Sarvesh Mehtani Vaidehi Patil Abhijeet Awasthi Partha P. Talukdar Sunita Sarawagi 76 32 0 07 Jun 2021
On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation Ruidan He Linlin Liu Hai Ye Qingyu Tan Bosheng Ding Liying Cheng Jia-Wei Low Lidong Bing Luo Si 65 204 0 06 Jun 2021
MergeDistill: Merging Pre-trained Language Models using Distillation Simran Khanuja Melvin Johnson Partha P. Talukdar 84 16 0 05 Jun 2021
nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models? Mihir Kale Aditya Siddhant Noah Constant Melvin Johnson Rami Al-Rfou Linting Xue LRM 70 25 0 03 Jun 2021
Syntax-augmented Multilingual BERT for Cross-lingual Transfer Wasi Uddin Ahmad Haoran Li Kai-Wei Chang Yashar Mehdad 71 34 0 03 Jun 2021
How to Adapt Your Pretrained Multilingual Model to 1600 Languages Abteen Ebrahimi Katharina Kann LRM VLM 98 70 0 03 Jun 2021
Language Embeddings for Typology and Cross-lingual Transfer Learning Dian Yu Taiqi He Kenji Sagae 69 12 0 03 Jun 2021
A Dataset and Baselines for Multilingual Reply Suggestion Mozhi Zhang Wei Wang Budhaditya Deb Guoqing Zheng Milad Shokouhi Ahmed Hassan Awadallah LRM 56 8 0 03 Jun 2021
Self-Guided Contrastive Learning for BERT Sentence Representations Taeuk Kim Kang Min Yoo Sang-goo Lee SSL 109 205 0 03 Jun 2021
ZmBART: An Unsupervised Cross-lingual Transfer Framework for Language Generation Kaushal Kumar Maurya M. Desarkar Yoshinobu Kano K. Deepshikha 67 38 0 03 Jun 2021
NewsEmbed: Modeling News through Pre-trained Document Representations Jialu Liu Tianqi Liu Cong Yu VLM 214 12 0 01 Jun 2021
Learning Domain-Specialised Representations for Cross-Lingual Biomedical Entity Linking Fangyu Liu Ivan Vulić Anna Korhonen Nigel Collier 86 49 0 30 May 2021
ByT5: Towards a token-free future with pre-trained byte-to-byte models Linting Xue Aditya Barua Noah Constant Rami Al-Rfou Sharan Narang Mihir Kale Adam Roberts Colin Raffel 158 509 0 28 May 2021
Deception detection in text and its relation to the cultural dimension of individualism/collectivism Katerina Papantoniou P. Papadakos Theodore Patkos G. Flouris Ion Androutsopoulos Dimitris Plexousakis 94 7 0 26 May 2021
Cross-lingual Text Classification with Heterogeneous Graph Neural Network ZiYun Wang Xuan Liu Pei-Yin Yang Shixing Liu Zhisheng Wang 76 32 0 24 May 2021
KLUE: Korean Language Understanding Evaluation Sungjoon Park Jihyung Moon Sungdong Kim Won Ik Cho Jiyoon Han ... Seonghyun Kim Lucy Park Alice Oh Jung-Woo Ha Kyunghyun Cho ELM VLM 123 198 0 20 May 2021
Analysing The Impact Of Linguistic Features On Cross-Lingual Transfer B. Dolički Gerasimos Spanakis 75 18 0 12 May 2021
Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models Laura Pérez-Mayos Alba Táboas García Simon Mille Leo Wanner ELM LRM 49 8 0 10 May 2021
XeroAlign: Zero-Shot Cross-lingual Transformer Alignment Milan Gritta Ignacio Iacobacci 84 21 0 06 May 2021
MOROCCO: Model Resource Comparison Framework Valentin Malykh Alexander Kukushkin Ekaterina Artemova Vladislav Mikhailov Maria Tikhonova Tatiana Shavrina 57 0 0 29 Apr 2021
Morph Call: Probing Morphosyntactic Content of Multilingual Transformers Vladislav Mikhailov O. Serikov Ekaterina Artemova 86 9 0 26 Apr 2021
XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond Francesco Barbieri Luis Espinosa Anke Jose Camacho-Collados 261 228 0 25 Apr 2021
Problems and Countermeasures in Natural Language Processing Evaluation Qingxiu Dong Zhifang Sui Weidong Zhan Baobao Chang ELM 37 2 0 20 Apr 2021
X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answering Meryem M'hamdi Doo Soon Kim Franck Dernoncourt Trung Bui Xiang Ren Jonathan May 93 20 0 20 Apr 2021
Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training Chenyi Lei Shixian Luo Yong Liu Wanggui He Jiamang Wang Guoxin Wang Haihong Tang Chunyan Miao Houqiang Li 60 42 0 19 Apr 2021
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding Yiheng Xu Tengchao Lv Lei Cui Guoxin Wang Yijuan Lu D. Florêncio Cha Zhang Furu Wei MLLM VLM 121 130 0 18 Apr 2021
Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders Guanhua Chen Shuming Ma Yun-Nung Chen Li Dong Dongdong Zhang Jianxiong Pan Wenping Wang Furu Wei 73 41 0 18 Apr 2021