Post-hoc analysis of Arabic transformer models

18 October 2022

Papers citing "Post-hoc analysis of Arabic transformer models"

33 / 33 papers shown

Title
Discovering Salient Neurons in Deep NLP Models Nadir Durrani Fahim Dalvi Hassan Sajjad KELM MILM 39 16 0 27 Jun 2022
Discovering Latent Concepts Learned in BERT Fahim Dalvi A. Khan Firoj Alam Nadir Durrani Jia Xu Hassan Sajjad SSL 38 58 0 15 May 2022
Neuron-level Interpretation of Deep NLP Models: A Survey Hassan Sajjad Nadir Durrani Fahim Dalvi MILM AI4CE 54 83 0 30 Aug 2021
How transfer learning impacts linguistic knowledge in deep NLP models? Nadir Durrani Hassan Sajjad Fahim Dalvi 23 50 0 31 May 2021
Effect of Post-processing on Contextualized Word Representations Hassan Sajjad Firoj Alam Fahim Dalvi Nadir Durrani 25 9 0 15 Apr 2021
The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models Go Inoue Bashar Alhafni Nurpeiis Baimukan Houda Bouamor Nizar Habash 58 232 0 11 Mar 2021
Pre-Training BERT on Arabic Tweets: Practical Considerations Ahmed Abdelali Sabit Hassan Hamdy Mubarak Kareem Darwish Younes Samih 53 98 0 21 Feb 2021
AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding Wissam Antoun Fady Baly Hazem M. Hajj 37 105 0 31 Dec 2020
ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic Muhammad Abdul-Mageed AbdelRahim Elmadany El Moatez Billah Nagoudi VLM 84 455 0 27 Dec 2020
Analyzing Individual Neurons in Pre-trained Language Models Nadir Durrani Hassan Sajjad Fahim Dalvi Yonatan Belinkov MILM 29 104 0 06 Oct 2020
KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social Media Ali Safaya Moutasem Abdullatif Deniz Yuret 54 316 0 26 Jul 2020
Compositional Explanations of Neurons Jesse Mu Jacob Andreas FAtt CoGe MILM 36 173 0 24 Jun 2020
Finding Experts in Transformer Models Xavier Suau Luca Zappella N. Apostoloff 33 31 0 15 May 2020
AraBERT: Transformer-based Model for Arabic Language Understanding Wissam Antoun Fady Baly Hazem M. Hajj 81 959 0 28 Feb 2020
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 152 6,454 0 05 Nov 2019
On the Linguistic Representational Power of Neural Machine Translation Models Yonatan Belinkov Nadir Durrani Fahim Dalvi Hassan Sajjad James R. Glass MILM 56 72 0 01 Nov 2019
Overview for the Second Shared Task on Language Identification in Code-Switched Data Giovanni Molina F. Alghamdi Mahmoud A. Ghoneim A. Hawwari Nicolas Rey-Villamizar Mona T. Diab Thamar Solorio 40 167 0 28 Sep 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 246 6,420 0 26 Sep 2019
Designing and Interpreting Probes with Control Tasks John Hewitt Percy Liang 56 531 0 08 Sep 2019
BERT Rediscovers the Classical NLP Pipeline Ian Tenney Dipanjan Das Ellie Pavlick MILM SSeg 100 1,458 0 15 May 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 95 728 0 21 Mar 2019
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks Matthew E. Peters Sebastian Ruder Noah A. Smith 57 435 0 14 Mar 2019
NeuroX: A Toolkit for Analyzing Individual Neurons in Neural Networks Fahim Dalvi Avery Nortonsmith A. Bau Yonatan Belinkov Hassan Sajjad Nadir Durrani James R. Glass 32 52 0 21 Dec 2018
What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Models Fahim Dalvi Nadir Durrani Hassan Sajjad Yonatan Belinkov A. Bau James R. Glass MILM 41 187 0 21 Dec 2018
Identifying and Controlling Important Neurons in Neural Machine Translation A. Bau Yonatan Belinkov Hassan Sajjad Nadir Durrani Fahim Dalvi James R. Glass MILM 52 182 0 03 Nov 2018
Targeted Syntactic Evaluation of Language Models Rebecca Marvin Tal Linzen 58 414 0 27 Aug 2018
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 272 888 0 03 May 2018
Colorless green recurrent networks dream hierarchically Kristina Gulordava Piotr Bojanowski Edouard Grave Tal Linzen Marco Baroni 66 503 0 29 Mar 2018
Visualisation and 'diagnostic classifiers' reveal how recurrent and recursive neural networks process hierarchical structure Dieuwke Hupkes Sara Veldhoen Willem H. Zuidema 56 274 0 28 Nov 2017
What do Neural Machine Translation Models Learn about Morphology? Yonatan Belinkov Nadir Durrani Fahim Dalvi Hassan Sajjad James R. Glass 85 414 0 11 Apr 2017
1.5 billion words Arabic Corpus I. A. El-Khair 3DV 34 98 0 12 Nov 2016
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies Tal Linzen Emmanuel Dupoux Yoav Goldberg 75 898 0 04 Nov 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 736 149,474 0 22 Dec 2014