Unsupervised Cross-lingual Representation Learning at Scale

5 November 2019

Francisco Guzmán

Luke Zettlemoyer

Papers citing "Unsupervised Cross-lingual Representation Learning at Scale"

50 / 1,223 papers shown

Title
PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao VLM CLL 34 41 0 22 Aug 2022
Pseudo-Labels Are All You Need Bogdan Kostić Mathis Lucka Julian Risch 29 2 0 19 Aug 2022
BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classification Vinura Dhananjaya Piyumal Demotte Surangika Ranathunga Sanath Jayasena 32 14 0 16 Aug 2022
TexPrax: A Messaging Application for Ethical, Real-time Data Collection and Annotation Lorenz Stangier Ji-Ung Lee Yuxi Wang Marvin Müller Nicholas R. J. Frick J. Metternich Iryna Gurevych 30 3 0 16 Aug 2022
BERT(s) to Detect Multiword Expressions Damith Premasiri Tharindu Ranasinghe 30 5 0 16 Aug 2022
A Comprehensive Survey of Natural Language Generation Advances from the Perspective of Digital Deception Keenan I. Jones Enes ALTUNCU V. N. Franqueira Yi-Chia Wang Shujun Li DeLMO 47 3 0 11 Aug 2022
Learning New Skills after Deployment: Improving open-domain internet-driven dialogue with human feedback Jing Xu Megan Ung M. Komeili Kushal Arora Y-Lan Boureau Jason Weston 30 37 0 05 Aug 2022
BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage Kurt Shuster Jing Xu M. Komeili Da Ju Eric Michael Smith ... Naman Goyal Arthur Szlam Y-Lan Boureau Melanie Kambadur Jason Weston LM&Ro KELM 37 235 0 05 Aug 2022
Cross-lingual Approaches for the Detection of Adverse Drug Reactions in German from a Patient's Perspective Lisa Raithel Philippe E. Thomas Roland Roller Oliver Sapina Sebastian Möller Pierre Zweigenbaum 27 2 0 03 Aug 2022
Cross-Lingual Knowledge Transfer for Clinical Phenotyping Jens-Michalis Papaioannou Paul Grundmann Betty van Aken A. Samaras Ilias Kyparissidis G. Giannakoulas Felix Alexander Gers Alexander Loser 44 6 0 03 Aug 2022
AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model Saleh Soltan Shankar Ananthakrishnan Jack G. M. FitzGerald Rahul Gupta Wael Hamza ... Mukund Sridhar Fabian Triefenbach Apurv Verma Gokhan Tur Premkumar Natarajan 63 82 0 02 Aug 2022
Multilingual Coreference Resolution in Multiparty Dialogue Boyuan Zheng Patrick Xia M. Yarmohammadi Benjamin Van Durme 58 3 0 02 Aug 2022
On the Limitations of Sociodemographic Adaptation with Transformers Chia-Chien Hung Anne Lauscher Dirk Hovy Simone Paolo Ponzetto Goran Glavaš 37 0 0 01 Aug 2022
ASTA: Learning Analytical Semantics over Tables for Intelligent Data Analysis and Visualization Lingbo Li Tianle Li Xinyi He Mengyu Zhou Shi Han Dongmei Zhang LMTD 47 0 0 01 Aug 2022
Efficient Long-Text Understanding with Short-Text Models Maor Ivgi Uri Shaham Jonathan Berant VLM 38 76 0 01 Aug 2022
Mismatching-Aware Unsupervised Translation Quality Estimation For Low-Resource Languages Fatemeh Azadi Heshaam Faili M. Dousti 30 4 0 31 Jul 2022
Domain Specific Wav2vec 2.0 Fine-tuning For The SE&R 2022 Challenge A. I. S. Ferreira Gustavo dos Reis Oliveira 27 3 0 29 Jul 2022
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? Yi Tay Mostafa Dehghani Samira Abnar Hyung Won Chung W. Fedus J. Rao Sharan Narang Vinh Q. Tran Dani Yogatama Donald Metzler AI4CE 34 100 0 21 Jul 2022
On the cross-lingual transferability of multilingual prototypical models across NLU tasks Oralie Cattan Christophe Servan S. Rosset 34 9 0 19 Jul 2022
Benchmarking Transformers-based models on French Spoken Language Understanding tasks Oralie Cattan Sahar Ghannay Christophe Servan Sophie Rosset 36 4 0 19 Jul 2022
Z-Index at CheckThat! Lab 2022: Check-Worthiness Identification on Tweet Text Prerona Tarannum Firoj Alam Md. Arid Hasan S. R. H. Noori 24 6 0 15 Jul 2022
Language Modelling with Pixels Phillip Rust Jonas F. Lotz Emanuele Bugliarello Elizabeth Salesky Miryam de Lhoneux Desmond Elliott VLM 43 46 0 14 Jul 2022
BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Sampling Javier de la Rosa E. G. Ponferrada Paulo Villegas Pablo González de Prado Salas Manu Romero María Grandury 35 95 0 14 Jul 2022
Zero-shot Cross-lingual Transfer is Under-specified Optimization Shijie Wu Benjamin Van Durme Mark Dredze 33 6 0 12 Jul 2022
HLT-MT: High-resource Language-specific Training for Multilingual Neural Machine Translation Jian Yang Yuwei Yin Shuming Ma Dongdong Zhang Zhoujun Li Furu Wei 42 8 0 11 Jul 2022
AsNER -- Annotated Dataset and Baseline for Assamese Named Entity recognition Dhrubajyoti Pathak Sukumar Nandi Priyankoo Sarmah 43 8 0 07 Jul 2022
Cross-Lingual QA as a Stepping Stone for Monolingual Open QA in Icelandic Vésteinn Snæbjarnarson H. Einarsson 30 5 0 05 Jul 2022
Masked Autoencoders in 3D Point Cloud Representation Learning Jincen Jiang Xuequan Lu Lizhi Zhao Richard Dazeley Meili Wang 3DPC ViT 59 28 0 04 Jul 2022
Vietnamese Capitalization and Punctuation Recovery Models Hoang Thi Thu Uyen Nguyen Anh Tu Ta Duc Huy 32 4 0 04 Jul 2022
Emotion Analysis using Multi-Layered Networks for Graphical Representation of Tweets Anna Nguyen Antonio Longa Massimiliano Luca Joe Kaul Gabriel Lopez 48 12 0 02 Jul 2022
Domain Adaptive Pretraining for Multilingual Acronym Extraction Usama Yaseen Stefan Langer 26 2 0 30 Jun 2022
"Diversity and Uncertainty in Moderation" are the Key to Data Selection for Multilingual Few-shot Transfer Shanu Kumar Sandipan Dandapat Monojit Choudhury 31 6 0 30 Jun 2022
GPTs at Factify 2022: Prompt Aided Fact-Verification Pawan Kumar Sahu Saksham Aggarwal Taneesh Gupta Gyanendra Das 27 1 0 29 Jun 2022
SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice Mohit Singhal Chen Ling Pujan Paudel Poojitha Thota Nihal Kumarswamy Gianluca Stringhini Shirin Nilizadeh 75 28 0 29 Jun 2022
TweetNLP: Cutting-Edge Natural Language Processing for Social Media Jose Camacho-Collados Kiamehr Rezaee Talayeh Riahi Asahi Ushio Daniel Loureiro ... Eugenio Martínez-Cámara Gonzalo Medina T. Buhrmann Leonardo Neves Francesco Barbieri VLM AI4MH 39 132 0 29 Jun 2022
Distilling a Pretrained Language Model to a Multilingual ASR Model Kwanghee Choi Hyung-Min Park VLM 33 11 0 25 Jun 2022
Insights into Pre-training via Simpler Synthetic Tasks Yuhuai Wu Felix Li Percy Liang AIMat 30 20 0 21 Jun 2022
Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generation Shengyao Zhuang Houxing Ren Linjun Shou Jian Pei Ming Gong Guido Zuccon Daxin Jiang 47 65 0 21 Jun 2022
Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Models Paul Röttger Haitham Seelawi Debora Nozza Zeerak Talat Bertie Vidgen 30 65 0 20 Jun 2022
GAAMA 2.0: An Integrated System that Answers Boolean and Extractive Questions Scott McCarley Mihaela A. Bornea Sara Rosenthal Anthony Ferritto Md Arafat Sultan Avirup Sil Radu Florian 16 1 0 16 Jun 2022
CS-UM6P at SemEval-2022 Task 6: Transformer-based Models for Intended Sarcasm Detection in English and Arabic Abdelkader El Mahdaouy Abdellah El Mekki Kabil Essefar Abderrahman Skiredj Ismail Berrada 19 10 0 16 Jun 2022
DIALOG-22 RuATD Generated Text Detection Narek Maloyan Bulat Nutfullin Eugene Ilyushin DeLMO 30 8 0 16 Jun 2022
Estimating Confidence of Predictions of Individual Classifiers and Their Ensembles for the Genre Classification Task Mikhail Lepekhin S. Sharoff UQCV 21 5 0 15 Jun 2022
Language Models are General-Purpose Interfaces Y. Hao Haoyu Song Li Dong Shaohan Huang Zewen Chi Wenhui Wang Shuming Ma Furu Wei MLLM 35 96 0 13 Jun 2022
Sort by Structure: Language Model Ranking as Dependency Probing Max Müller-Eberstein Rob van der Goot Barbara Plank 46 3 0 10 Jun 2022
Ancestor-to-Creole Transfer is Not a Walk in the Park Heather Lent Emanuele Bugliarello Anders Søgaard 11 8 0 09 Jun 2022
Finding the Right Recipe for Low Resource Domain Adaptation in Neural Machine Translation Virginia Adams Sandeep Subramanian Mike Chrzanowski Oleksii Hrinchuk Oleksii Kuchaiev 38 2 0 02 Jun 2022
Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language Detection J. Eronen M. Ptaszynski Fumito Masui Masaki Arata Gniewosz Leliwa Michal Wroczynski 32 31 0 02 Jun 2022
HYU at SemEval-2022 Task 2: Effective Idiomaticity Detection with Consideration at Different Levels of Contextualization Young-moon Joung Taeuk Kim 36 1 0 01 Jun 2022
GateNLP-UShef at SemEval-2022 Task 8: Entity-Enriched Siamese Transformer for Multilingual News Article Similarity Iknoor Singh Yue Li Melissa Thong Carolina Scarton 33 3 0 31 May 2022