ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,912 papers shown

Title
TimesBERT: A BERT-Style Foundation Model for Time Series Understanding Haoran Zhang Yong Liu Yunzhong Qiu Haixuan Liu Zhongyi Pei Jianmin Wang Mingsheng Long AI4TS 45 0 0 28 Feb 2025
Uncertainty Quantification in Retrieval Augmented Question Answering Laura Perez-Beltrachini Mirella Lapata RALM 48 0 0 25 Feb 2025
Robust Bias Detection in MLMs and its Application to Human Trait Ratings Ingroj Shrestha Louis Tay Padmini Srinivasan 78 0 0 24 Feb 2025
Towards Typologically Aware Rescoring to Mitigate Unfaithfulness in Lower-Resource Languages Tsan Tsai Chan Xin Tong Thi Thu Uyen Hoang Barbare Tepnadze Wojciech Stempniak 36 0 0 24 Feb 2025
Encryption-Friendly LLM Architecture Donghwan Rho Taeseong Kim Minje Park Jung Woo Kim Hyunsik Chae Jung Hee Cheon Ernest K. Ryu 57 2 0 24 Feb 2025
Reasoning with Latent Thoughts: On the Power of Looped Transformers Nikunj Saunshi Nishanth Dikkala Zhiyuan Li Sanjiv Kumar Sashank J. Reddi OffRL LRM AI4CE 64 10 0 24 Feb 2025
Pay Attention to Real World Perturbations! Natural Robustness Evaluation in Machine Reading Comprehension Yulong Wu Viktor Schlegel R. Batista-Navarro AAML 36 0 0 23 Feb 2025
Iterative Auto-Annotation for Scientific Named Entity Recognition Using BERT-Based Models Kartik Gupta 52 0 0 22 Feb 2025
Comprehensive Analysis of Transparency and Accessibility of ChatGPT, DeepSeek, And other SoTA Large Language Models Ranjan Sapkota Shaina Raza Manoj Karkee 48 4 0 21 Feb 2025
Hyperspherical Energy Transformer with Recurrent Depth Yunzhe Hu Difan Zou Dong Xu 48 0 0 17 Feb 2025
Enhancing Auto-regressive Chain-of-Thought through Loop-Aligned Reasoning Qifan Yu Zhenyu He Sijie Li Xun Zhou Jun Zhang Jingjing Xu Di He OffRL LRM 89 4 0 12 Feb 2025
LLM4GNAS: A Large Language Model Based Toolkit for Graph Neural Architecture Search Yang Gao Hong Yang Y. Chen Junxian Wu Peng Zhang Haishuai Wang 48 0 0 12 Feb 2025
Al-Khwarizmi: Discovering Physical Laws with Foundation Models Christopher E. Mower Haitham Bou-Ammar AI4CE 76 1 0 03 Feb 2025
SecPE: Secure Prompt Ensembling for Private and Robust Large Language Models Jiawen Zhang Kejia Chen Zunlei Feng Jian Lou Mingli Song Jiaheng Liu Xiaoyu Yang AAML SILM FedML 45 1 0 02 Feb 2025
AdditiveLLM: Large Language Models Predict Defects in Additive Manufacturing P. Pak A. Farimani AI4CE 70 0 0 29 Jan 2025
A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics Kai He Rui Mao Qika Lin Yucheng Ruan Xiang Lan Mengling Feng Erik Cambria LM&MA AILaw 93 154 0 28 Jan 2025
A Review on Self-Supervised Learning for Time Series Anomaly Detection: Recent Advances and Open Challenges Aitor Sánchez-Ferrera Borja Calvo Jose A. Lozano AI4TS 40 0 0 28 Jan 2025
Merino: Entropy-driven Design for Generative Language Models on IoT Devices Youpeng Zhao Ming Lin Huadong Tang Qiang Wu Jun Wang 83 0 0 28 Jan 2025
EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition Hamid Nasiri Peter Garraghan 41 1 0 21 Jan 2025
Reference-free Evaluation Metrics for Text Generation: A Survey Takumi Ito Kees van Deemter Jun Suzuki ELM 41 2 0 21 Jan 2025
TAD-Bench: A Comprehensive Benchmark for Embedding-Based Text Anomaly Detection Yang Cao Sikun Yang Chen Li Haolong Xiang Lianyong Qi Bo Liu Rongsheng Li Ming Liu 49 0 0 21 Jan 2025
A Contrastive Framework with User, Item and Review Alignment for Recommendation Hoang V. Dong Yuan Fang Hady W. Lauw 37 2 0 21 Jan 2025
Assessing and Enhancing the Robustness of Large Language Models with Task Structure Variations for Logical Reasoning Qiming Bao Gael Gendron A. Peng Wanjun Zhong N. Tan Yang Chen Michael Witbrock Jiaheng Liu LRM ELM 73 2 0 20 Jan 2025
Harnessing the Potential of Large Language Models in Modern Marketing Management: Applications, Future Directions, and Strategic Recommendations Raha Aghaei Ali A. Kiaei Mahnaz Boush Javad Vahidi Mohammad Zavvar Zeynab Barzegar Mahan Rofoosheh OffRL 40 1 0 18 Jan 2025
A Comprehensive Survey of Foundation Models in Medicine Wasif Khan Seowung Leem Kyle B. See Joshua K. Wong Shaoting Zhang R. Fang AI4CE LM&MA VLM 105 18 0 17 Jan 2025
Bridging the Fairness Gap: Enhancing Pre-trained Models with LLM-Generated Sentences Liu Yu Ludie Guo Ping Kuang Fan Zhou 44 0 0 12 Jan 2025
Multi-task Visual Grounding with Coarse-to-Fine Consistency Constraints Ming Dai Jian Li Jiedong Zhuang Xian Zhang Wankou Yang ObjD 42 1 0 12 Jan 2025
Finnish SQuAD: A Simple Approach to Machine Translation of Span Annotations Emil Nuutinen Iiro Rastas Filip Ginter 40 1 0 10 Jan 2025
Merging Feed-Forward Sublayers for Compressed Transformers Neha Verma Kenton W. Murray Kevin Duh AI4CE 50 0 0 10 Jan 2025
Clinical Insights: A Comprehensive Review of Language Models in Medicine Nikita Neveditsin Pawan Lingras V. Mago LM&MA 58 4 0 08 Jan 2025
Trust Modeling in Counseling Conversations: A Benchmark Study Aseem Srivastava Zuhair Hasan Shaik Tanmoy Chakraborty Md. Shad Akhtar 38 0 0 06 Jan 2025
Decoding News Bias: Multi Bias Detection in News Articles Bhushan Santosh Shah Deven Santosh Shah Vahida Attar 41 0 0 05 Jan 2025
Swift Cross-Dataset Pruning: Enhancing Fine-Tuning Efficiency in Natural Language Understanding Binh-Nguyen Nguyen Yang He 41 1 0 05 Jan 2025
Efficient support ticket resolution using Knowledge Graphs Sherwin Varghese James Tian 30 0 0 03 Jan 2025
Toward Corpus Size Requirements for Training and Evaluating Depression Risk Models Using Spoken Language Tomek Rutowski Amir Harati Elizabeth Shriberg Yang Lu Piotr Chlebek Ricardo Oliveira 41 7 0 03 Jan 2025
A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine Hanguang Xiao Feizhong Zhou X. Liu Tianqi Liu Zhipeng Li Xin Liu Xiaoxuan Huang AILaw LM&MA LRM 61 18 0 31 Dec 2024
Text Classification: Neural Networks VS Machine Learning Models VS Pre-trained Models Christos Petridis VLM 38 1 0 31 Dec 2024
SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memes Palash Nandi Shivam Sharma Tanmoy Chakraborty 36 1 0 31 Dec 2024
AIGT: AI Generative Table Based on Prompt Mingming Zhang Zhiqing Xiao Guoshan Lu Sai Wu Weiqiang Wang Xing Fu Can Yi Junbo Zhao LMTD VLM 42 2 0 24 Dec 2024
Adversarial Robustness through Dynamic Ensemble Learning Hetvi Waghela Jaydip Sen Sneha Rakshit AAML 88 0 0 20 Dec 2024
COSEE: Consistency-Oriented Signal-Based Early Exiting via Calibrated Sample Weighting Mechanism Jianing He Qi Zhang Hongyun Zhang Xuanjing Huang Usman Naseem Duoqian Miao 64 1 0 17 Dec 2024
Unlocking LLMs: Addressing Scarce Data and Bias Challenges in Mental Health Vivek Kumar Eirini Ntoutsi Pushpraj Singh Rajawat Giacomo Medda Diego Reforgiato Recupero AI4MH 81 0 0 17 Dec 2024
Bias Vector: Mitigating Biases in Language Models with Task Arithmetic Approach Daiki Shirafuji Makoto Takenaka Shinya Taguchi LLMAG 72 0 0 16 Dec 2024
One Pixel is All I Need Deng Siqin Zhou Xiaoyi ViT 146 0 0 14 Dec 2024
BinarySelect to Improve Accessibility of Black-Box Attack Research Shatarupa Ghosh Jonathan Rusert AAML 79 0 0 13 Dec 2024
SMMF: Square-Matricized Momentum Factorization for Memory-Efficient Optimization Kwangryeol Park Seulki Lee 63 0 0 12 Dec 2024
Coverage-based Fairness in Multi-document Summarization Haoyuan Li Yusen Zhang Rui Zhang Snigdha Chaturvedi 80 0 0 11 Dec 2024
KITE-DDI: A Knowledge graph Integrated Transformer Model for accurately predicting Drug-Drug Interaction Events from Drug SMILES and Biomedical Knowledge Graph Azwad Tamir Jiann-Shiun Yuan 70 0 0 08 Dec 2024
AntLM: Bridging Causal and Masked Language Models Xinru Yu Bin Guo Shiwei Luo J. Wang Tao Ji Yuanbin Wu CLL 77 1 0 04 Dec 2024
Generative Language Models Potential for Requirement Engineering Applications: Insights into Current Strengths and Limitations Summra Saleem Muhammad Nabeel Asim L. V. Elst Andreas Dengel 75 0 0 01 Dec 2024