AraBERT: Transformer-based Model for Arabic Language Understanding

28 February 2020

Papers citing "AraBERT: Transformer-based Model for Arabic Language Understanding"

50 / 279 papers shown

Title
UPV at CheckThat! 2021: Mitigating Cultural Differences for Identifying Multilingual Check-worthy Claims Ipek Baris Schlicht Angel Felipe Magnossão de Paula Paolo Rosso 42 11 0 19 Sep 2021
Cross-lingual Transfer of Monolingual Models Evangelia Gogoulou Ariel Ekgren T. Isbister Magnus Sahlgren 29 17 0 15 Sep 2021
Sentiment Analysis in Poems in Misurata Sub-dialect -- A Sentiment Detection in an Arabic Sub-dialect Azza Abugharsa 17 5 0 15 Sep 2021
COMBO: State-of-the-Art Morphosyntactic Analysis Mateusz Klimaszewski Alina Wróblewska AI4CE 24 4 0 11 Sep 2021
Temporal Pyramid Transformer with Multimodal Interaction for Video Question Answering Min Peng Chongyang Wang Yuan Gao Yu Shi Xiangdong Zhou 50 3 0 10 Sep 2021
BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation Haoran Xu Benjamin Van Durme Kenton W. Murray 50 57 0 09 Sep 2021
Empathetic Dialogue Generation with Pre-trained RoBERTa-GPT2 and External Knowledge Ye Liu Wolfgang Maier Wolfgang Minker Stefan Ultes AI4CE 31 20 0 07 Sep 2021
AraT5: Text-to-Text Transformers for Arabic Language Generation El Moatez Billah Nagoudi AbdelRahim Elmadany Muhammad Abdul-Mageed 89 118 0 31 Aug 2021
Transfer Learning for Multi-lingual Tasks -- a Survey A. Jafari Behnam Heidary R. Farahbakhsh Mostafa Salehi Mahdi Jalili LRM 29 5 0 28 Aug 2021
Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens Itay Itzhak Omer Levy 17 18 0 25 Aug 2021
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha VLM LM&MA 26 261 0 12 Aug 2021
WLV-RIT at GermEval 2021: Multitask Learning with Transformers to Detect Toxic, Engaging, and Fact-Claiming Comments Skye Morgan Tharindu Ranasinghe Marcos Zampieri 29 6 0 30 Jul 2021
COMBO: a new module for EUD parsing Mateusz Klimaszewski Alina Wróblewska MoE 17 4 0 08 Jul 2021
New Arabic Medical Dataset for Diseases Classification Jaafar Hammoud A. Vatian N. Dobrenko N. Vedernikov A. Shalyto N. Gusarova OOD 11 6 0 29 Jun 2021
QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpus Hamdy Mubarak A. Hussein Shammur A. Chowdhury Ahmed M. Ali 14 44 0 24 Jun 2021
Deep Multi-Task Model for Sarcasm Detection and Sentiment Analysis in Arabic Language Abdelkader El Mahdaouy Abdellah El Mekki Kabil Essefar Nabil El Mamoun Ismail Berrada A. Khoumsi 11 35 0 23 Jun 2021
Evaluating Various Tokenizers for Arabic Text Classification Zaid Alyafeai Maged S. Al-Shaibani Mustafa Ghaleb Irfan Ahmad 29 41 0 14 Jun 2021
Cross-lingual Emotion Detection Sabit Hassan Shaden Shaar Kareem Darwish 27 12 0 10 Jun 2021
MergeDistill: Merging Pre-trained Language Models using Distillation Simran Khanuja Melvin Johnson Partha P. Talukdar 27 16 0 05 Jun 2021
belabBERT: a Dutch RoBERTa-based language model applied to psychiatric classification J. Wouts J. D. Boer A. Voppel S. Brederoo S. V. Splunter I. Sommer 14 4 0 02 Jun 2021
A systematic review of Hate Speech automatic detection using Natural Language Processing Md Saroar Jahan Mourad Oussalah 37 8 0 22 May 2021
AraCOVID19-MFH: Arabic COVID-19 Multi-label Fake News and Hate Speech Detection Dataset Mohamed Seghir Hadj Ameur H. Aliane 13 129 0 07 May 2021
Security Vulnerability Detection Using Deep Learning Natural Language Processing Noah Ziems Shaoen Wu 19 55 0 06 May 2021
ZEN 2.0: Continue Training and Adaption for N-gram Enhanced Text Encoders Yan Song Tong Zhang Yonggang Wang Kai-Fu Lee 46 43 0 04 May 2021
Transformers to Fight the COVID-19 Infodemic Lasitha Uyangodage Tharindu Ranasinghe Hansi Hettiarachchi 40 12 0 25 Apr 2021
AMMU : A Survey of Transformer-based Biomedical Pretrained Language Models Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha LM&MA MedIm 26 164 0 16 Apr 2021
LU-BZU at SemEval-2021 Task 2: Word2Vec and Lemma2Vec performance in Arabic Word-in-Context disambiguation Moustafa Al-Hajj Mustafa Jarrar 27 14 0 16 Apr 2021
Zero-Resource Multi-Dialectal Arabic Natural Language Understanding Muhammad Khalifa Hesham A. Hassan A. Fahmy 20 6 0 14 Apr 2021
Let-Mi: An Arabic Levantine Twitter Dataset for Misogynistic Language Hala Mulki Bilal Ghanem 11 40 0 18 Mar 2021
On the Role of Images for Analyzing Claims in Social Media Gullal Singh Cheema Sherzod Hakimov Eric Müller-Budack Ralph Ewerth 18 10 0 17 Mar 2021
The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models Go Inoue Bashar Alhafni Nurpeiis Baimukan Houda Bouamor Nizar Habash 35 224 0 11 Mar 2021
Combining Context-Free and Contextualized Representations for Arabic Sarcasm Detection and Sentiment Identification Amey Hengle Atharva Kshirsagar Shaily Desai M. Marathe 14 13 0 09 Mar 2021
Automatic Difficulty Classification of Arabic Sentences Nouran Khallaf S. Sharoff 14 12 0 07 Mar 2021
Empathetic BERT2BERT Conversational Model: Learning Arabic Language Generation with Little Data Tarek Naous Wissam Antoun Reem A. Mahmoud Hazem M. Hajj 44 18 0 07 Mar 2021
NADI 2021: The Second Nuanced Arabic Dialect Identification Shared Task Muhammad Abdul-Mageed Chiyu Zhang AbdelRahim Elmadany Houda Bouamor Nizar Habash 13 75 0 04 Mar 2021
AraBERT and Farasa Segmentation Based Approach For Sarcasm and Sentiment Detection in Arabic Tweets Anshul Wadhawan 19 29 0 02 Mar 2021
Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task Badr AlKhamissi Mohamed Gabr Muhammad N. ElNokrashy Khaled Essam 18 17 0 01 Mar 2021
Bilingual Language Modeling, A transfer learning technique for Roman Urdu Usama Khalid M. O. Beg Muhammad Umair Arshad 19 3 0 22 Feb 2021
Pre-Training BERT on Arabic Tweets: Practical Considerations Ahmed Abdelali Sabit Hassan Hamdy Mubarak Kareem Darwish Younes Samih 20 96 0 21 Feb 2021
Dialect Identification in Nuanced Arabic Tweets Using Farasa Segmentation and AraBERT Anshul Wadhawan 21 6 0 19 Feb 2021
Transfer Learning Approach for Arabic Offensive Language Detection System -- BERT-Based Model Fatemah Husain Özlem Uzuner 15 11 0 09 Feb 2021
HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognition Avihay Chriqui I. Yahav 39 36 0 03 Feb 2021
BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweets Fouzi Harrag Maria Dabbah Kareem Darwish Ahmed Abdelali DeLMO 14 23 0 22 Jan 2021
BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla Abhik Bhattacharjee Tahmid Hasan Wasi Uddin Ahmad Kazi Samin Mubasshir Md. Saiful Islam Anindya Iqbal M. Rahman Rifat Shahriyar SSL VLM 25 166 0 01 Jan 2021
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models Phillip Rust Jonas Pfeiffer Ivan Vulić Sebastian Ruder Iryna Gurevych 80 235 0 31 Dec 2020
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 24 126 0 31 Dec 2020
AraGPT2: Pre-Trained Transformer for Arabic Language Generation Wissam Antoun Fady Baly Hazem M. Hajj VLM 21 103 0 31 Dec 2020
AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding Wissam Antoun Fady Baly Hazem M. Hajj 19 102 0 31 Dec 2020
ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic Muhammad Abdul-Mageed AbdelRahim Elmadany El Moatez Billah Nagoudi VLM 62 448 0 27 Dec 2020
Leveraging ParsBERT and Pretrained mT5 for Persian Abstractive Text Summarization Mehrdad Farahani Mohammad Gharachorloo Mohammad Manthouri 17 23 0 21 Dec 2020