v1v2v3v4v5v6 (latest)

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

ArXiv (abs)PDF HTML Github (3271★)

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,935 papers shown

Title
Understanding Survey Paper Taxonomy about Large Language Models via Graph Representation Learning Jun Zhuang C. Kennington 37 10 0 16 Feb 2024
Reusing Softmax Hardware Unit for GELU Computation in Transformers C. Peltekis K. Alexandridis G. Dimitrakopoulos 38 1 0 15 Feb 2024
OrderBkd: Textual backdoor attack through repositioning Irina Alekseevskaia Konstantin Arkhipenko 73 3 0 12 Feb 2024
Large Language Models: A Survey Shervin Minaee Tomas Mikolov Narjes Nikzad M. Asgari-Chenaghlu R. Socher Xavier Amatriain Jianfeng Gao ALM LM&MA ELM 244 425 0 09 Feb 2024
Traditional Machine Learning Models and Bidirectional Encoder Representations From Transformer (BERT)-Based Automatic Classification of Tweets About Eating Disorders: Algorithm Development and Validation Study J. Benítez-Andrades José-Manuel Alija-Pérez Maria-Esther Vidal R. Pastor-Vargas María Teresa García-Ordás 61 36 0 08 Feb 2024
Empowering machine learning models with contextual knowledge for enhancing the detection of eating disorders in social media posts J. Benítez-Andrades María Teresa García-Ordás Mayra Russo Ahmad Sakor Luis Daniel Fernandes Rotger Maria-Esther Vidal AI4MH 155 3 0 08 Feb 2024
Improving Agent Interactions in Virtual Environments with Language Models Jack Zhang LLMAG 54 0 0 08 Feb 2024
Triplet Interaction Improves Graph Transformers: Accurate Molecular Graph Learning with Triplet Graph Transformers Md Shamim Hussain Mohammed J Zaki D. Subramanian ViT 115 8 0 07 Feb 2024
Lens: A Foundation Model for Network Traffic in Cybersecurity Qineng Wang Chen Qian Xiaochang Li Ziyu Yao Huajie Shao 21 7 0 06 Feb 2024
DE $^3$ -BERT: Distance-Enhanced Early Exiting for BERT based on Prototypical Networks Jianing He Qi Zhang Weiping Ding Duoqian Miao Jun Zhao Liang Hu LongBing Cao 91 3 0 03 Feb 2024
Fractal Patterns May Illuminate the Success of Next-Token Prediction Ibrahim Alabdulmohsin Vinh Q. Tran Mostafa Dehghani 45 2 0 02 Feb 2024
Distractor Generation for Multiple-Choice Questions: A Survey of Methods, Datasets, and Evaluation Elaf Alhazmi Quan Z. Sheng W. Zhang Munazza Zaib A. Alhazmi AI4Ed 80 1 0 02 Feb 2024
Dive into the Chasm: Probing the Gap between In- and Cross-Topic Generalization Andreas Waldis Yufang Hou Iryna Gurevych ELM 75 8 0 02 Feb 2024
Investigating Recurrent Transformers with Dynamic Halt Jishnu Ray Chowdhury Cornelia Caragea 182 1 0 01 Feb 2024
Comparing Template-based and Template-free Language Model Probing Sagi Shaier Kevin Bennett Lawrence E Hunter Katharina von der Wense ELM 96 4 0 31 Jan 2024
Desiderata for the Context Use of Question Answering Systems Sagi Shaier Lawrence E Hunter Katharina von der Wense 123 5 0 31 Jan 2024
PipeNet: Question Answering with Semantic Pruning over Knowledge Graphs Ying Su Jipeng Zhang Yangqiu Song Tong Zhang 62 1 0 31 Jan 2024
Fine-tuning Transformer-based Encoder for Turkish Language Understanding Tasks Savas Yildirim 35 7 0 30 Jan 2024
When Large Language Models Meet Vector Databases: A Survey Zhi Jing Yongye Su Yikun Han Bo Yuan Haiyun Xu Chunjiang Liu Kehai Chen Min Zhang 138 38 0 30 Jan 2024
GuReT: Distinguishing Guilt and Regret related Text S. Butt F. Balouchzahi Abdul Gafar Manuel Meque Maaz Amjad Hector G. Ceballos Cancino Grigori Sidorov Alexander Gelbukh 37 0 0 29 Jan 2024
X-PEFT: eXtremely Parameter-Efficient Fine-Tuning for Extreme Multi-Profile Scenarios Namju Kwak Taesup Kim MoE 31 0 0 29 Jan 2024
BPDec: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretraining Wen-Chieh Liang Youzhi Liang OffRL 49 2 0 29 Jan 2024
Credit Risk Meets Large Language Models: Building a Risk Indicator from Loan Descriptions in P2P Lending Mario Sanz-Guerrero Javier Arroyo 97 6 0 29 Jan 2024
Quantifying Stereotypes in Language Yang Liu 62 1 0 28 Jan 2024
Semantics of Multiword Expressions in Transformer-Based Models: A Survey Filip Miletić Sabine Schulte im Walde 88 8 0 27 Jan 2024
A Comprehensive Survey of Compression Algorithms for Language Models Seungcheol Park Jaehyeon Choi Sojin Lee U. Kang MQ 116 16 0 27 Jan 2024
Socially Aware Synthetic Data Generation for Suicidal Ideation Detection Using Large Language Models Hamideh Ghanadian I. Nejadgholi Hussein Al Osman SyDa 77 25 0 25 Jan 2024
A Comparative Analysis of Noise Reduction Methods in Sentiment Analysis on Noisy Bangla Texts Kazi Toufique Elahi Tasnuva Binte Rahman Shakil Shahriar Samir Sarker Md. Tanvir Rouf Shawon G. M. Shahariar 54 1 0 25 Jan 2024
Rethinking Patch Dependence for Masked Autoencoders Letian Fu Long Lian Renhao Wang Baifeng Shi Xudong Wang Adam Yala Trevor Darrell Alexei A. Efros Ken Goldberg 136 16 0 25 Jan 2024
SEDAC: A CVAE-Based Data Augmentation Method for Security Bug Report Identification Y. Liao T. Zhang 19 0 0 22 Jan 2024
Freely Long-Thinking Transformer (FraiLT) Akbay Tabak 20 0 0 21 Jan 2024
Robust Evaluation Measures for Evaluating Social Biases in Masked Language Models Yang Liu 37 2 0 21 Jan 2024
Instructional Fingerprinting of Large Language Models Lyne Tchapmi Fei Wang Mingyu Derek Ma Pang Wei Koh Chaowei Xiao Muhao Chen WaLM 67 33 0 21 Jan 2024
Finding a Needle in the Adversarial Haystack: A Targeted Paraphrasing Approach For Uncovering Edge Cases with Minimal Distribution Distortion Aly M. Kassem Sherif Saad AAML 56 1 0 21 Jan 2024
Attentive Fusion: A Transformer-based Approach to Multimodal Hate Speech Detection Atanu Mandal Gargi Roy Amit Barman Indranil Dutta S. Naskar 34 3 0 19 Jan 2024
Learning High-Quality and General-Purpose Phrase Representations Lihu Chen Gaël Varoquaux Fabian M. Suchanek 99 3 0 18 Jan 2024
Preparing Lessons for Progressive Training on Language Models Yu Pan Ye Yuan Yichun Yin Jiaxin Shi Zenglin Xu Ming Zhang Lifeng Shang Xin Jiang Qun Liu 70 9 0 17 Jan 2024
Fixed Point Diffusion Models Xingjian Bai Luke Melas-Kyriazi 71 3 0 16 Jan 2024
The What, Why, and How of Context Length Extension Techniques in Large Language Models -- A Detailed Survey Saurav Pawar S.M. Towhidul Islam Tonmoy S. M. M. Zaman Vinija Jain Aman Chadha Amitava Das 68 29 0 15 Jan 2024
Milestones in Bengali Sentiment Analysis leveraging Transformer-models: Fundamentals, Challenges and Future Directions Saptarshi Sengupta Shreya Ghosh Prasenjit Mitra Tarikul Islam Tamiti 66 2 0 15 Jan 2024
Developing ChatGPT for Biology and Medicine: A Complete Review of Biomedical Question Answering Qing Li Lei Li Yu Li LM&MA AI4MH 80 7 0 15 Jan 2024
Harnessing Large Language Models Over Transformer Models for Detecting Bengali Depressive Social Media Text: A Comprehensive Study Ahmadul Karim Chowdhury Saidur Rahman Sujon Md. Shirajus Salekin Shafi Tasin Ahmmad Sifat Ahmed Khan Md. Hasib Faisal Muhammad Shah AI4MH 88 17 0 14 Jan 2024
Stylometry Analysis of Multi-authored Documents for Authorship and Author Style Change Detection Muhammad Tayyab Zamir Muhammad Asif Ayub Asma Gul Nasir Ahmad Kashif Ahmad 49 2 0 12 Jan 2024
Reliability Analysis of Psychological Concept Extraction and Classification in User-penned Text Muskan Garg Msvpj Sathvik Amrit Chadha Shaina Raza Sunghwan Sohn AI4MH 50 1 0 12 Jan 2024
LLMRS: Unlocking Potentials of LLM-Based Recommender Systems for Software Purchase Angela John Theophilus Aidoo Hamayoon Behmanush Irem B. Gunduz Hewan Shrestha M. R. Rahman Wolfgang Maass 53 2 0 12 Jan 2024
Multi-Task Learning for Front-End Text Processing in TTS Wonjune Kang Yun Wang Shun Zhang Arthur Hinsvark Qing He 59 2 0 12 Jan 2024
Autocompletion of Chief Complaints in the Electronic Health Records using Large Language Models K M Sajjadul Islam Ayesha Siddika Nipu Praveen Madiraju Priya Deshpande LM&MA 67 7 0 11 Jan 2024
Phishing Website Detection through Multi-Model Analysis of HTML Content Furkan Çolhak Mert İlhan Ecevit Bilal Emir Uçar Reiner Creutzburg Hasan Dag 49 8 0 09 Jan 2024
Setting the Record Straight on Transformer Oversmoothing G. Dovonon M. Bronstein Matt J. Kusner 88 6 0 09 Jan 2024
MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts Maciej Pióro Kamil Ciebiera Krystian Król Jan Ludziejewski Michał Krutul Jakub Krajewski Szymon Antoniak Piotr Miłoś Marek Cygan Sebastian Jaszczur MoE Mamba 84 56 0 08 Jan 2024