Unsupervised Cross-lingual Representation Learning at Scale

5 November 2019

Francisco Guzmán

Luke Zettlemoyer

Papers citing "Unsupervised Cross-lingual Representation Learning at Scale"

50 / 1,143 papers shown

Title
Bangla Text Classification using Transformers Tanvirul Alam A. Khan Firoj Alam 28 34 0 09 Nov 2020
Machine Generation and Detection of Arabic Manipulated and Fake News El Moatez Billah Nagoudi AbdelRahim Elmadany Muhammad Abdul-Mageed Tariq Alhindi H. Cavusoglu DeLMO 24 50 0 05 Nov 2020
EXAMS: A Multi-Subject High School Examinations Dataset for Cross-Lingual and Multilingual Question Answering Momchil Hardalov Todor Mihaylov Dimitrina Zlatkova Yoan Dinkov Ivan Koychev Preslav Nakov AI4Ed ELM 41 50 0 05 Nov 2020
Detecting Hallucinated Content in Conditional Neural Sequence Generation Chunting Zhou Graham Neubig Jiatao Gu Mona T. Diab P. Guzmán Luke Zettlemoyer Marjan Ghazvininejad HILM 39 195 0 05 Nov 2020
Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages Kushal Kumar Jain Adwait Deshpande Kumar Shridhar F. Laumann Ayushman Dash 51 51 0 04 Nov 2020
Introducing various Semantic Models for Amharic: Experimentation and Evaluation with multiple Tasks and Datasets Seid Muhie Yimam A. Ayele Gopalakrishnan Venkatesh Ibrahim Gashaw Christian Biemann 30 27 0 02 Nov 2020
Emergent Communication Pretraining for Few-Shot Machine Translation Yaoyiran Li Edoardo Ponti Ivan Vulić Anna Korhonen 25 19 0 02 Nov 2020
TransQuest: Translation Quality Estimation with Cross-lingual Transformers Tharindu Ranasinghe Constantin Orasan R. Mitkov ViT 22 108 0 01 Nov 2020
UPB at SemEval-2020 Task 12: Multilingual Offensive Language Detection on Social Media by Fine-tuning a Variety of BERT-based Models Mircea-Adrian Tanase Dumitru-Clementin Cercel Costin-Gabriel Chiru 6 15 0 26 Oct 2020
Multilingual Speech Translation with Efficient Finetuning of Pretrained Models Xian Li Changhan Wang Yun Tang C. Tran Yuqing Tang J. Pino Alexei Baevski Alexis Conneau Michael Auli 21 6 0 24 Oct 2020
Rethinking embedding coupling in pre-trained language models Hyung Won Chung Thibault Févry Henry Tsai Melvin Johnson Sebastian Ruder 95 142 0 24 Oct 2020
Char2Subword: Extending the Subword Embedding Space Using Robust Character Compositionality Gustavo Aguilar Bryan McCann Tong Niu Nazneen Rajani N. Keskar Thamar Solorio 49 12 0 24 Oct 2020
Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering Arij Riabi Thomas Scialom Rachel Keraron Benoît Sagot Djamé Seddah Jacopo Staiano 142 52 0 23 Oct 2020
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond Xin Li Lidong Bing Wenxuan Zhang Zheng Li Wai Lam 54 25 0 23 Oct 2020
XOR QA: Cross-lingual Open-Retrieval Question Answering Akari Asai Jungo Kasai J. Clark Kenton Lee Eunsol Choi Hannaneh Hajishirzi 14 145 0 22 Oct 2020
German's Next Language Model Branden Chan Stefan Schweter Timo Möller 27 264 0 21 Oct 2020
Towards End-to-End In-Image Neural Machine Translation Elman Mansimov Mitchell Stern Mengzhao Chen Orhan Firat Jakob Uszkoreit Puneet Jain 27 25 0 20 Oct 2020
An Empirical Study for Vietnamese Constituency Parsing with Pre-training Tuan-Vi Tran Xuan-Thien Pham Duc-Vu Nguyen Kiet Van Nguyen Ngan Luu-Thuy Nguyen 44 4 0 19 Oct 2020
The RELX Dataset and Matching the Multilingual Blanks for Cross-Lingual Relation Classification Abdullatif Köksal Arzucan Özgür 38 19 0 19 Oct 2020
X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models Zhengbao Jiang Antonios Anastasopoulos Jun Araki Haibo Ding Graham Neubig HILM KELM 21 138 0 13 Oct 2020
Model Selection for Cross-Lingual Transfer Yang Chen Alan Ritter 23 12 0 13 Oct 2020
Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models Zirui Wang Yulia Tsvetkov Orhan Firat Yuan Cao 33 196 0 12 Oct 2020
Probing Pretrained Language Models for Lexical Semantics Ivan Vulić Edoardo Ponti Robert Litschko Goran Glavas Anna Korhonen KELM 33 233 0 12 Oct 2020
Load What You Need: Smaller Versions of Multilingual BERT Amine Abdaoui Camille Pradel Grégoire Sigel 47 72 0 12 Oct 2020
SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task Z. Li Hai Zhao Rui Wang Kehai Chen Masao Utiyama Eiichiro Sumita 36 15 0 11 Oct 2020
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor Xinyu Wang Yong-jia Jiang Zhaohui Yan Zixia Jia Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 26 10 0 10 Oct 2020
Automated Concatenation of Embeddings for Structured Prediction Xinyu Wang Yong-jia Jiang Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 35 172 0 10 Oct 2020
Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages Michael A. Hedderich David Ifeoluwa Adelani D. Zhu Jesujoba Oluwadara Alabi Udia Markus Dietrich Klakow 17 72 0 07 Oct 2020
The Multilingual Amazon Reviews Corpus Phillip Keung Y. Lu György Szarvas Noah A. Smith 19 190 0 06 Oct 2020
Multi-task Learning for Multilingual Neural Machine Translation Yiren Wang Chengxiang Zhai Hany Awadalla 37 68 0 06 Oct 2020
A Pilot Study of Text-to-SQL Semantic Parsing for Vietnamese A. Nguyen M. Dao Dat Quoc Nguyen 6 54 0 05 Oct 2020
Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank Ethan C. Chau Lucy H. Lin Noah A. Smith 19 15 0 29 Sep 2020
What does it mean to be language-agnostic? Probing multilingual sentence encoders for typological properties Rochelle Choenni Ekaterina Shutova 25 37 0 27 Sep 2020
WESSA at SemEval-2020 Task 9: Code-Mixed Sentiment Analysis using Transformers Ahmed A. Sultan Mahmoud Salim Amina Gaber Islam El Hosary 33 8 0 21 Sep 2020
Will it Unblend? Yuval Pinter Cassandra L. Jacobs Jacob Eisenstein 21 14 0 18 Sep 2020
COMET: A Neural Framework for MT Evaluation Ricardo Rei Craig Alan Stewart Ana C. Farinha A. Lavie 34 1,036 0 18 Sep 2020
Improving Indonesian Text Classification Using Multilingual Language Model Ilham Firdausi Putra Ayu Purwarianti 13 7 0 12 Sep 2020
FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding Yuwei Fang Shuohang Wang Zhe Gan S. Sun Jingjing Liu VLM 23 58 0 10 Sep 2020
kk2018 at SemEval-2020 Task 9: Adversarial Training for Code-Mixing Sentiment Classification Jiaxiang Liu Xuyi Chen Shikun Feng Shuohuan Wang Ouyang Xuan Yu Sun Zhengjie Huang Weiyue Su 30 19 0 08 Sep 2020
Multi-Label Sentiment Analysis on 100 Languages with Dynamic Weighting for Label Imbalance Selim F. Yilmaz E. Kaynak Aykut Koç H. Dibeklioğlu Suleyman Serdar Kozat 37 26 0 26 Aug 2020
On Learning Language-Invariant Representations for Universal Machine Translation Hao Zhao Junjie Hu Andrej Risteski 40 8 0 11 Aug 2020
Multilingual Translation with Extensible Multilingual Pretraining and Finetuning Y. Tang C. Tran Xian Li Peng-Jen Chen Naman Goyal Vishrav Chaudhary Jiatao Gu Angela Fan CLL 52 447 0 02 Aug 2020
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering Shayne Longpre Yi Lu Joachim Daiber ELM HILM 41 152 0 30 Jul 2020
FiSSA at SemEval-2020 Task 9: Fine-tuned For Feelings Bertelt Braaksma R. Scholtens Stan van Suijlekom Remy Wang Ahmet Üstün 23 3 0 24 Jul 2020
Effects of Language Relatedness for Cross-lingual Transfer Learning in Character-Based Language Models Mittul Singh Peter Smit Sami Virpioja M. Kurimo 21 0 0 22 Jul 2020
Fighting the COVID-19 Infodemic in Social Media: A Holistic Perspective and a Call to Arms Firoj Alam Fahim Dalvi Shaden Shaar Nadir Durrani Hamdy Mubarak ... Giovanni Da San Martino Ahmed Abdelali Hassan Sajjad Kareem Darwish Preslav Nakov 22 102 0 15 Jul 2020
TICO-19: the Translation Initiative for Covid-19 Antonios Anastasopoulos A. Cattelan Zi-Yi Dou Marcello Federico C. Federman ... Mengmeng Niu A. Oktem Eric Paquin G. Tang Sylwia Tur 19 90 0 03 Jul 2020
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding Dmitry Lepikhin HyoukJoong Lee Yuanzhong Xu Dehao Chen Orhan Firat Yanping Huang M. Krikun Noam M. Shazeer Z. Chen MoE 43 1,116 0 30 Jun 2020
Pre-training via Paraphrasing M. Lewis Marjan Ghazvininejad Gargi Ghosh Armen Aghajanyan Sida I. Wang Luke Zettlemoyer AIMat 30 159 0 26 Jun 2020
Unsupervised Cross-lingual Representation Learning for Speech Recognition Alexis Conneau Alexei Baevski R. Collobert Abdel-rahman Mohamed Michael Auli SSL 70 754 0 24 Jun 2020