Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfer

11 December 2020

Papers citing "Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfer"

24 / 24 papers shown

Title
On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatment Zirui Wang Zachary Chase Lipton Yulia Tsvetkov 28 31 0 06 Oct 2020
MultiCQA: Zero-Shot Transfer of Self-Supervised Text Matching Models on a Massive Scale Andreas Rucklé Jonas Pfeiffer Iryna Gurevych 43 37 0 02 Oct 2020
English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too Jason Phang Iacer Calixto Phu Mon Htut Yada Pruksachatkun Haokun Liu Clara Vania Katharina Kann Samuel R. Bowman LRM 44 66 0 26 May 2020
Are All Languages Created Equal in Multilingual BERT? Shijie Wu Mark Dredze 41 320 0 18 May 2020
XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning Edoardo Ponti Goran Glavaš Olga Majewska Qianchu Liu Ivan Vulić Anna Korhonen LRM 51 315 0 01 May 2020
AdapterFusion: Non-Destructive Task Composition for Transfer Learning Jonas Pfeiffer Aishwarya Kamath Andreas Rucklé Kyunghyun Cho Iryna Gurevych CLL MoMe 102 837 0 01 May 2020
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 77 618 0 30 Apr 2020
Extending Multilingual BERT to Low-Resource Languages Zihan Wang Karthikeyan K Stephen D. Mayhew Dan Roth VLM 31 127 0 28 Apr 2020
The State and Fate of Linguistic Diversity and Inclusion in the NLP World Pratik M. Joshi Sebastin Santy A. Budhiraja Kalika Bali Monojit Choudhury LMTD 57 822 0 20 Apr 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 128 966 0 24 Mar 2020
Parameter Space Factorization for Zero-Shot Learning across Tasks and Languages Edoardo Ponti Ivan Vulić Ryan Cotterell Marinela Parović Roi Reichart Anna Korhonen BDL 54 29 0 30 Jan 2020
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 126 6,454 0 05 Nov 2019
Episodic Memory in Lifelong Language Learning Cyprien de Masson dÁutume Sebastian Ruder Lingpeng Kong Dani Yogatama CLL KELM 95 285 0 03 Jun 2019
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks Matthew E. Peters Sebastian Ruder Noah A. Smith 52 435 0 14 Mar 2019
Parameter-Efficient Transfer Learning for NLP N. Houlsby A. Giurgiu Stanislaw Jastrzebski Bruna Morrone Quentin de Laroussilhe Andrea Gesmundo Mona Attariyan Sylvain Gelly 154 4,368 0 02 Feb 2019
How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions Goran Glavaš Robert Litschko Sebastian Ruder Ivan Vulić ELM 45 183 0 01 Feb 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 808 93,936 0 11 Oct 2018
XNLI: Evaluating Cross-lingual Sentence Representations Alexis Conneau Guillaume Lample Ruty Rinott Adina Williams Samuel R. Bowman Holger Schwenk Veselin Stoyanov ELM 42 1,366 0 13 Sep 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 314 129,831 0 12 Jun 2017
Learning multiple visual domains with residual adapters Sylvestre-Alvise Rebuffi Hakan Bilen Andrea Vedaldi OOD 67 924 0 22 May 2017
Adversarial Multi-task Learning for Text Classification Pengfei Liu Xipeng Qiu Xuanjing Huang 72 609 0 19 Apr 2017
A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Tasks Kazuma Hashimoto Caiming Xiong Yoshimasa Tsuruoka R. Socher KELM 68 575 0 05 Nov 2016
Domain Separation Networks Konstantinos Bousmalis George Trigeorgis N. Silberman Dilip Krishnan D. Erhan OOD 56 1,442 0 22 Aug 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 519 149,474 0 22 Dec 2014