v1v2v3v4v5 (latest)

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 March 2020

Graham Neubig

Papers citing "XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization"

50 / 666 papers shown

Title
Multilingual CheckList: Generation and Evaluation Karthikeyan K Shaily Bhatt Pankaj Singh Somak Aditya Sandipan Dandapat Sunayana Sitaram Monojit Choudhary ELM 74 1 0 24 Mar 2022
Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferability Yoshinari Fujinuma Jordan L. Boyd-Graber Katharina Kann AAML 151 26 0 21 Mar 2022
XTREME-S: Evaluating Cross-lingual Speech Representations Alexis Conneau Ankur Bapna Yu Zhang Min Ma Patrick von Platen ... Orhan Firat Michael Auli Sebastian Ruder Jason Riesa Melvin Johnson VLM AILaw ELM 158 22 0 21 Mar 2022
$Meta-X$_{NLG}$: A Meta-Learning Approach Based on Language Clustering for Zero-Shot Cross-Lingual Transfer and Generation$ Meta-X $_{NLG}$ : A Meta-Learning Approach Based on Language Clustering for Zero-Shot Cross-Lingual Transfer and Generation Kaushal Kumar Maurya M. Desarkar 85 8 0 19 Mar 2022
Challenges and Strategies in Cross-Cultural NLP Daniel Hershcovich Stella Frank Heather Lent Miryam de Lhoneux Mostafa Abdou ... Ruixiang Cui Constanza Fierro Katerina Margatina Phillip Rust Anders Søgaard 137 182 0 18 Mar 2022
CrossAligner & Co: Zero-Shot Transfer Methods for Task-Oriented Cross-lingual Natural Language Understanding Milan Gritta Ruoyu Hu Ignacio Iacobacci 105 12 0 18 Mar 2022
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation Xinyi Wang Sebastian Ruder Graham Neubig 100 63 0 17 Mar 2022
Combining Static and Contextualised Multilingual Embeddings Katharina Hämmerl Jindrich Libovický Alexander Fraser 76 11 0 17 Mar 2022
Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation? E. Lee Sarubi Thillainathan Shravan Nayak Surangika Ranathunga David Ifeoluwa Adelani Ruisi Su Arya D. McCarthy VLM 110 44 0 16 Mar 2022
Geographic Adaptation of Pretrained Language Models Valentin Hofmann Goran Glavaš Nikola Ljubevsić J. Pierrehumbert Hinrich Schütze VLM 128 18 0 16 Mar 2022
Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure Yuan Chai Yaobo Liang Nan Duan LRM 68 23 0 16 Mar 2022
MCoNaLa: A Benchmark for Code Generation from Multiple Natural Languages Zhiruo Wang Grace Cuenca Shuyan Zhou Frank F. Xu Graham Neubig 98 51 0 16 Mar 2022
Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction Kuan-Hao Huang I-Hung Hsu Premkumar Natarajan Kai-Wei Chang Nanyun Peng 73 68 0 15 Mar 2022
FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing Ilias Chalkidis Tommaso Pasini Shenmin Zhang Letizia Tomada Sebastian Felix Schwemer Anders Søgaard AILaw 96 54 0 14 Mar 2022
Overlap-based Vocabulary Generation Improves Cross-lingual Transfer Among Related Languages Vaidehi Patil Partha P. Talukdar Sunita Sarawagi 122 22 0 03 Mar 2022
Mukayese: Turkish NLP Strikes Back Ali Safaya Emirhan Kurtulucs Arda Goktougan Deniz Yuret 80 23 0 02 Mar 2022
Large-Scale Hate Speech Detection with Cross-Domain Transfer Cagri Toraman Furkan Şahinuç E. Yilmaz 126 63 0 02 Mar 2022
CINO: A Chinese Minority Pre-trained Language Model Ziqing Yang Zihang Xu Yiming Cui Baoxin Wang Min Lin Dayong Wu Zhigang Chen 86 25 0 28 Feb 2022
Multi-Level Contrastive Learning for Cross-Lingual Alignment Beiduo Chen Wu Guo Bin Gu Quan Liu Yongchao Wang 86 5 0 26 Feb 2022
Toward More Meaningful Resources for Lower-resourced Languages Constantine Lignos Nolan Holley Chester Palen-Michel Jonne Saleva 56 20 0 24 Feb 2022
NoisyTune: A Little Noise Can Help You Finetune Pretrained Language Models Better Chuhan Wu Fangzhao Wu Tao Qi Yongfeng Huang Xing Xie 79 60 0 24 Feb 2022
Delving Deeper into Cross-lingual Visual Question Answering Chen Cecilia Liu Jonas Pfeiffer Anna Korhonen Ivan Vulić Iryna Gurevych 107 9 0 15 Feb 2022
Slovene SuperGLUE Benchmark: Translation and Evaluation Aleš Žagar Marko Robnik-Šikonja 58 10 0 10 Feb 2022
What are the best systems? New perspectives on NLP Benchmarking Pierre Colombo Nathan Noiry Ekhine Irurozki Stephan Clémençon 205 42 0 08 Feb 2022
mSLAM: Massively multilingual joint pre-training for speech and text Ankur Bapna Colin Cherry Yu Zhang Ye Jia Melvin Johnson Yong Cheng Simran Khanuja Jason Riesa Alexis Conneau VLM 73 114 0 03 Feb 2022
Constrained Density Matching and Modeling for Cross-lingual Alignment of Contextualized Representations Wei Zhao Steffen Eger 75 1 0 31 Jan 2022
Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation Olga Majewska E. Razumovskaia Edoardo Ponti Ivan Vulić Anna Korhonen 113 28 0 31 Jan 2022
IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages Emanuele Bugliarello Fangyu Liu Jonas Pfeiffer Siva Reddy Desmond Elliott Edoardo Ponti Ivan Vulić MLLM VLM ELM 123 64 0 27 Jan 2022
HC4: A New Suite of Test Collections for Ad Hoc CLIR Dawn J Lawrie J. Mayfield Douglas W. Oard Eugene Yang VLM AILaw 87 30 0 24 Jan 2022
Leaf: Multiple-Choice Question Generation Kristiyan Vachev Momchil Hardalov Georgi Karadzhov Georgi Georgiev Ivan Koychev Preslav Nakov AI4Ed 72 23 0 22 Jan 2022
Ensemble Transformer for Efficient and Accurate Ranking Tasks: an Application to Question Answering Systems Yoshitomo Matsubara Luca Soldaini Eric Lind Alessandro Moschitti 89 7 0 15 Jan 2022
A Warm Start and a Clean Crawled Corpus -- A Recipe for Good Language Models Vésteinn Snæbjarnarson Haukur Barri Símonarson Pétur Orri Ragnarsson Svanhvít Lilja Ingólfsdóttir H. Jónsson Vilhjálmur Þorsteinsson H. Einarsson 90 26 0 14 Jan 2022
Hypers at ComMA@ICON: Modelling Aggressiveness, Gender Bias and Communal Bias Identification Sean Benhur Roshan Nayak Kanchana Sivanraju Adeep Hande S. Navaneethakrishnan R. Priyadharshini Bharathi Raja Chakravarthi6 129 1 0 31 Dec 2021
Do Multi-Lingual Pre-trained Language Models Reveal Consistent Token Attributions in Different Languages? Junxiang Wang Xuchao Zhang Bo Zong Yanchi Liu Wei Cheng Jingchao Ni Haifeng Chen Liang Zhao AAML 64 0 0 23 Dec 2021
Semantics-Recovering Decompilation through Neural Machine Translation Ruigang Liang Ying Cao Peiwei Hu Jinwen He Kai Chen 64 4 0 22 Dec 2021
On Cross-Lingual Retrieval with Multilingual Text Encoders Robert Litschko Ivan Vulić Simone Paolo Ponzetto Goran Glavaš 89 38 0 21 Dec 2021
LMTurk: Few-Shot Learners as Crowdsourcing Workers in a Language-Model-as-a-Service Framework Mengjie Zhao Fei Mi Yasheng Wang Minglei Li Xin Jiang Qun Liu Hinrich Schütze RALM 115 11 0 14 Dec 2021
Extending the WILDS Benchmark for Unsupervised Adaptation Shiori Sagawa Pang Wei Koh Tony Lee Irena Gao Sang Michael Xie ... Kate Saenko Tatsunori Hashimoto Sergey Levine Chelsea Finn Percy Liang OOD 76 102 0 09 Dec 2021
Question Answering Survey: Directions, Challenges, Datasets, Evaluation Matrices Hariom A. Pandya Brijesh S. Bhatt 85 27 0 07 Dec 2021
Quantifying Adaptability in Pre-trained Language Models with 500 Tasks Belinda Z. Li Jane A. Yu Madian Khabsa Luke Zettlemoyer A. Halevy Jacob Andreas ELM 91 17 0 06 Dec 2021
How not to Lie with a Benchmark: Rearranging NLP Leaderboards Tatiana Shavrina Valentin Malykh ALM ELM 505 12 0 02 Dec 2021
Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples Linlin Liu Xin Li Ruidan He Lidong Bing Shafiq Joty Luo Si KELM 139 18 0 22 Nov 2021
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning V. Aribandi Yi Tay Tal Schuster J. Rao H. Zheng ... Jianmo Ni Jai Gupta Kai Hui Sebastian Ruder Donald Metzler MoE 127 216 0 22 Nov 2021
Reasonable Effectiveness of Random Weighting: A Litmus Test for Multi-Task Learning Baijiong Lin Feiyang Ye Yu Zhang Ivor W. Tsang 109 100 0 20 Nov 2021
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale Arun Babu Changhan Wang Andros Tjandra Kushal Lakhotia Qiantong Xu ... Yatharth Saraf J. Pino Alexei Baevski Alexis Conneau Michael Auli SSL 116 713 0 17 Nov 2021
Cross-language Information Retrieval P. Galuscáková Douglas W. Oard Suraj Nair 70 0 0 10 Nov 2021
Cross-lingual Adaption Model-Agnostic Meta-Learning for Natural Language Understanding Qianying Liu Fei Cheng Sadao Kurohashi 49 1 0 10 Nov 2021
LMdiff: A Visual Diff Tool to Compare Language Models Hendrik Strobelt Benjamin Hoover Arvind Satyanarayan Sebastian Gehrmann VLM 94 19 0 02 Nov 2021
Adapting to the Long Tail: A Meta-Analysis of Transfer Learning Research for Language Understanding Tasks Aakanksha Naik J. Lehman Carolyn Rose 104 7 0 02 Nov 2021
When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer Ameet Deshpande Partha P. Talukdar Karthik Narasimhan 115 39 0 27 Oct 2021