Unsupervised Cross-lingual Representation Learning at Scale

5 November 2019

Francisco Guzmán

Luke Zettlemoyer

Papers citing "Unsupervised Cross-lingual Representation Learning at Scale"

50 / 1,210 papers shown

Title
SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training Ankur Bapna Yu-An Chung Na Wu Anmol Gulati Ye Jia J. Clark Melvin Johnson Jason Riesa Alexis Conneau Yu Zhang VLM 64 94 0 20 Oct 2021
Neural Lexicon Reader: Reduce Pronunciation Errors in End-to-end TTS by Leveraging External Textual Knowledge Mutian He Jingzhou Yang Lei He Frank Soong 27 1 0 19 Oct 2021
NormFormer: Improved Transformer Pretraining with Extra Normalization Sam Shleifer Jason Weston Myle Ott AI4CE 33 74 0 18 Oct 2021
Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translation Guanhua Chen Shuming Ma Yun-Nung Chen Dongdong Zhang Jia Pan Wenping Wang Furu Wei LRM 31 14 0 16 Oct 2021
Substructure Distribution Projection for Zero-Shot Cross-Lingual Dependency Parsing Freda Shi Kevin Gimpel Karen Livescu 147 7 0 16 Oct 2021
Prix-LM: Pretraining for Multilingual Knowledge Base Construction Wenxuan Zhou Fangyu Liu Ivan Vulić Nigel Collier Muhao Chen KELM 72 18 0 16 Oct 2021
DS-TOD: Efficient Domain Specialization for Task Oriented Dialog Chia-Chien Hung Anne Lauscher Simone Paolo Ponzetto Goran Glavaš 39 31 0 15 Oct 2021
Span Detection for Aspect-Based Sentiment Analysis in Vietnamese Kim Thi-Thanh Nguyen Sieu Khai Huynh Luong Luc Phan P. Pham Duc-Vu Nguyen Kiet Van Nguyen 20 2 0 15 Oct 2021
A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classification Sosuke Nishikawa Ikuya Yamada Yoshimasa Tsuruoka Isao Echizen VLM 46 5 0 15 Oct 2021
GlobalWoZ: Globalizing MultiWoZ to Develop Multilingual Task-Oriented Dialogue Systems Bosheng Ding Junjie Hu Lidong Bing Sharifah Aljunied Mahani Chenyu You Luo Si Chunyan Miao 50 41 0 14 Oct 2021
On the Pitfalls of Analyzing Individual Neurons in Language Models Omer Antverg Yonatan Belinkov MILM 30 50 0 14 Oct 2021
Few-shot Controllable Style Transfer for Low-Resource Multilingual Settings Kalpesh Krishna Deepak Nathani Xavier Garcia Bidisha Samanta Partha P. Talukdar 42 24 0 14 Oct 2021
Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation Benjamin Muller Luca Soldaini Rik Koncel-Kedziorski Eric Lind Alessandro Moschitti LRM 38 8 0 14 Oct 2021
Automated Essay Scoring Using Transformer Models Sabrina Ludwig Christian W. F. Mayer Christopher Hansen Kerstin Eilers Steffen Brandt 19 39 0 13 Oct 2021
Learning Compact Metrics for MT Amy Pu Hyung Won Chung Ankur P. Parikh Sebastian Gehrmann Thibault Sellam 35 99 0 12 Oct 2021
Unsupervised Neural Machine Translation with Generative Language Models Only Jesse Michael Han Igor Babuschkin Harrison Edwards Arvind Neelakantan Tao Xu ... Alex Ray Pranav Shyam Aditya A. Ramesh Alec Radford Ilya Sutskever 52 36 0 11 Oct 2021
TEET! Tunisian Dataset for Toxic Speech Detection S. Gharbi Heger Arfaoui Hatem Haddad Mayssa Kchaou 4 5 0 11 Oct 2021
WeTS: A Benchmark for Translation Suggestion Zhen Yang Fandong Meng Yingxue Zhang Ernan Li Jie Zhou VLM 32 11 0 11 Oct 2021
Offensive Language Detection with BERT-based models, By Customizing Attention Probabilities Peyman Alavi Pouria Nikvand M. Shamsfard 29 5 0 11 Oct 2021
DMRST: A Joint Framework for Document-Level Multilingual RST Discourse Segmentation and Parsing Zhengyuan Liu Ke Shi Nancy F. Chen 28 30 0 09 Oct 2021
An Isotropy Analysis in the Multilingual BERT Embedding Space S. Rajaee Mohammad Taher Pilehvar 24 33 0 09 Oct 2021
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 101 992 0 09 Oct 2021
The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Results M. Fomicheva Piyawat Lertvittayakumjorn Wei Zhao Steffen Eger Yang Gao ELM 24 39 0 08 Oct 2021
SubTab: Subsetting Features of Tabular Data for Self-Supervised Representation Learning Talip Uçar Ehsan Hajiramezanali Lindsay Edwards LMTD SSL 39 124 0 08 Oct 2021
UoB at SemEval-2021 Task 5: Extending Pre-Trained Language Models to Include Task and Domain-Specific Information for Toxic Span Prediction E. Yan Harish Tayyar Madabushi 26 2 0 07 Oct 2021
Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learning Seanie Lee Haebeom Lee Juho Lee Sung Ju Hwang MoMe CLL 53 17 0 06 Oct 2021
AraCOVID19-SSD: Arabic COVID-19 Sentiment and Sarcasm Detection Dataset Mohamed Seghir Hadj Ameur H. Aliane 16 7 0 05 Oct 2021
TBCOV: Two Billion Multilingual COVID-19 Tweets with Sentiment, Entity, Geo, and Gender Labels Muhammad Imran U. Qazi Ferda Ofli 22 38 0 04 Oct 2021
Span Labeling Approach for Vietnamese and Chinese Word Segmentation Duc-Vu Nguyen Linh-Bao Vo D. Thin Ngan Luu-Thuy Nguyen 34 3 0 01 Oct 2021
Multi-granular Legal Topic Classification on Greek Legislation C. Papaloukas Ilias Chalkidis Konstantinos Athinaios D. Pantazi Manolis Koubarakis AILaw 45 23 0 30 Sep 2021
SlovakBERT: Slovak Masked Language Model Matúš Pikuliak Stefan Grivalsky Martin Konopka Miroslav Blšták Martin Tamajka Viktor Bachratý Marian Simko Pavol Balázik Michal Trnka Filip Uhlárik 35 26 0 30 Sep 2021
Multilingual AMR Parsing with Noisy Knowledge Distillation Deng Cai Xin Li Jackie Chun-Sing Ho Lidong Bing W. Lam 27 18 0 30 Sep 2021
StoryDB: Broad Multi-language Narrative Dataset Alexey Tikhonov Igor Samenko Ivan P. Yamshchikov 48 5 0 29 Sep 2021
One to rule them all: Towards Joint Indic Language Hate Speech Detection Mehar Bhatia Tenzin Singhay Bhotia Akshat Agarwal Prakash Ramesh Shubham Gupta Kumar Shridhar F. Laumann Ayushman Dash 61 16 0 28 Sep 2021
Exploring Teacher-Student Learning Approach for Multi-lingual Speech-to-Intent Classification Bidisha Sharma Maulik C. Madhavi Xuehao Zhou Haizhou Li 23 2 0 28 Sep 2021
FQuAD2.0: French Question Answering and knowing that you know nothing Quentin Heinrich Gautier Viaud Wacim Belblidia 11 8 0 27 Sep 2021
MFAQ: a Multilingual FAQ Dataset Maxime De Bruyn Ehsan Lotfi Jeska Buhmann Walter Daelemans RALM 50 21 0 27 Sep 2021
Rumour Detection via Zero-shot Cross-lingual Transfer Learning Lin Tian Xiuzhen Zhang Jey Han Lau 46 13 0 27 Sep 2021
On the Prunability of Attention Heads in Multilingual BERT Aakriti Budhraja Madhura Pande Pratyush Kumar Mitesh M. Khapra 52 4 0 26 Sep 2021
DziriBERT: a Pre-trained Language Model for the Algerian Dialect Amine Abdaoui Mohamed Berrimi Mourad Oussalah A. Moussaoui 32 43 0 25 Sep 2021
Monolingual and Cross-Lingual Acceptability Judgments with the Italian CoLA corpus Daniela Trotta R. Guarasci Elisa Leonardelli Sara Tonelli 44 30 0 24 Sep 2021
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers Yi Tay Mostafa Dehghani J. Rao W. Fedus Samira Abnar Hyung Won Chung Sharan Narang Dani Yogatama Ashish Vaswani Donald Metzler 206 111 0 22 Sep 2021
BARTpho: Pre-trained Sequence-to-Sequence Models for Vietnamese Nguyen Luong Tran Duong Minh Le Dat Quoc Nguyen 19 52 0 20 Sep 2021
DuRecDial 2.0: A Bilingual Parallel Corpus for Conversational Recommendation Zeming Liu Haifeng Wang Zheng-Yu Niu Hua Wu Wanxiang Che 23 56 0 18 Sep 2021
Locating Language-Specific Information in Contextualized Embeddings Sheng Liang Philipp Dufter Hinrich Schütze 30 7 0 16 Sep 2021
Language Models are Few-shot Multilingual Learners Genta Indra Winata Andrea Madotto Zhaojiang Lin Rosanne Liu J. Yosinski Pascale Fung ELM LRM 38 133 0 16 Sep 2021
Cross-lingual Transfer of Monolingual Models Evangelia Gogoulou Ariel Ekgren T. Isbister Magnus Sahlgren 31 18 0 15 Sep 2021
Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training Bo Zheng Li Dong Shaohan Huang Saksham Singhal Wanxiang Che Ting Liu Xia Song Furu Wei VLM 21 22 0 15 Sep 2021
Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translation Ke Min Wang Yangbin Shi Jiayi Wang Yuqi Zhang Yu Zhao Xiaolin Zheng 52 6 0 15 Sep 2021
A Conditional Generative Matching Model for Multi-lingual Reply Suggestion Budhaditya Deb Guoqing Zheng Milad Shokouhi Ahmed Hassan Awadallah 36 1 0 15 Sep 2021