Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfer

11 December 2020

Papers citing "Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfer"

24 / 24 papers shown

Title
On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatment Zirui Wang Zachary Chase Lipton Yulia Tsvetkov 35 31 0 06 Oct 2020
MultiCQA: Zero-Shot Transfer of Self-Supervised Text Matching Models on a Massive Scale Andreas Rucklé Jonas Pfeiffer Iryna Gurevych 54 37 0 02 Oct 2020
English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too Jason Phang Iacer Calixto Phu Mon Htut Yada Pruksachatkun Haokun Liu Clara Vania Katharina Kann Samuel R. Bowman LRM 53 66 0 26 May 2020
Are All Languages Created Equal in Multilingual BERT? Shijie Wu Mark Dredze 43 320 0 18 May 2020
XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning Edoardo Ponti Goran Glavaš Olga Majewska Qianchu Liu Ivan Vulić Anna Korhonen LRM 56 319 0 01 May 2020
AdapterFusion: Non-Destructive Task Composition for Transfer Learning Jonas Pfeiffer Aishwarya Kamath Andreas Rucklé Kyunghyun Cho Iryna Gurevych CLL MoMe 116 837 0 01 May 2020
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 85 618 0 30 Apr 2020
Extending Multilingual BERT to Low-Resource Languages Zihan Wang Karthikeyan K Stephen D. Mayhew Dan Roth VLM 33 127 0 28 Apr 2020
The State and Fate of Linguistic Diversity and Inclusion in the NLP World Pratik M. Joshi Sebastin Santy A. Budhiraja Kalika Bali Monojit Choudhury LMTD 64 822 0 20 Apr 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 131 966 0 24 Mar 2020
Parameter Space Factorization for Zero-Shot Learning across Tasks and Languages Edoardo Ponti Ivan Vulić Ryan Cotterell Marinela Parović Roi Reichart Anna Korhonen BDL 65 29 0 30 Jan 2020
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 154 6,496 0 05 Nov 2019
Episodic Memory in Lifelong Language Learning Cyprien de Masson dÁutume Sebastian Ruder Lingpeng Kong Dani Yogatama CLL KELM 106 285 0 03 Jun 2019
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks Matthew E. Peters Sebastian Ruder Noah A. Smith 60 435 0 14 Mar 2019
Parameter-Efficient Transfer Learning for NLP N. Houlsby A. Giurgiu Stanislaw Jastrzebski Bruna Morrone Quentin de Laroussilhe Andrea Gesmundo Mona Attariyan Sylvain Gelly 179 4,368 0 02 Feb 2019
How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions Goran Glavaš Robert Litschko Sebastian Ruder Ivan Vulić ELM 55 183 0 01 Feb 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 943 93,936 0 11 Oct 2018
XNLI: Evaluating Cross-lingual Sentence Representations Alexis Conneau Guillaume Lample Ruty Rinott Adina Williams Samuel R. Bowman Holger Schwenk Veselin Stoyanov ELM 48 1,366 0 13 Sep 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 435 129,831 0 12 Jun 2017
Learning multiple visual domains with residual adapters Sylvestre-Alvise Rebuffi Hakan Bilen Andrea Vedaldi OOD 86 924 0 22 May 2017
Adversarial Multi-task Learning for Text Classification Pengfei Liu Xipeng Qiu Xuanjing Huang 94 609 0 19 Apr 2017
A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Tasks Kazuma Hashimoto Caiming Xiong Yoshimasa Tsuruoka R. Socher KELM 70 575 0 05 Nov 2016
Domain Separation Networks Konstantinos Bousmalis George Trigeorgis N. Silberman Dilip Krishnan D. Erhan OOD 88 1,442 0 22 Aug 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 806 149,474 0 22 Dec 2014