v1v2v3v4v5v6 (latest)

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

ArXiv (abs)PDF HTML Github (3271★)

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,935 papers shown

Title
LLM for SoC Security: A Paradigm Shift Dipayan Saha Shams Tarek Katayoon Yahyaei S. Saha Jingbo Zhou M. Tehranipoor Farimah Farahmandi 172 54 0 09 Oct 2023
IDTraffickers: An Authorship Attribution Dataset to link and connect Potential Human-Trafficking Operations on Text Escort Advertisements V. Saxena Benjamin Bashpole Gijs Van Dijck Gerasimos Spanakis 102 2 0 09 Oct 2023
Empower Nested Boolean Logic via Self-Supervised Curriculum Learning Hongqiu Wu Linfeng Liu Haizhen Zhao Min Zhang LRM AI4CE NAI ELM 81 7 0 09 Oct 2023
On the Zero-Shot Generalization of Machine-Generated Text Detectors Xiao Pu Jingyu Zhang Xiaochuang Han Yulia Tsvetkov Tianxing He DeLMO 58 16 0 08 Oct 2023
ZooPFL: Exploring Black-box Foundation Models for Personalized Federated Learning Wang Lu Hao Yu Jindong Wang Damien Teney Haohan Wang Yiqiang Chen Qiang Yang Xing Xie Xiangyang Ji 97 8 0 08 Oct 2023
Counter Turing Test CT^2: AI-Generated Text Detection is Not as Easy as You May Think -- Introducing AI Detectability Index Megha Chakraborty S.M. Towhidul Islam Tonmoy S. M. Mehedi Krish Sharma Niyar R. Barman ... Tanay Kumar Vinija Jain Aman Chadha Amit P. Sheth Amitava Das DeLMO 82 21 0 08 Oct 2023
Compresso: Structured Pruning with Collaborative Prompting Learns Compact Large Language Models Song Guo Jiahang Xu Li Zhang Mao Yang 87 15 0 08 Oct 2023
MinPrompt: Graph-based Minimal Prompt Data Augmentation for Few-shot Question Answering Xiusi Chen Jyun-Yu Jiang Wei-Cheng Chang Cho-Jui Hsieh Hsiang-Fu Yu Wei Wang 95 12 0 08 Oct 2023
The Troubling Emergence of Hallucination in Large Language Models -- An Extensive Definition, Quantification, and Prescriptive Remediations Vipula Rawte Swagata Chakraborty Agnibh Pathak Anubhav Sarkar S.M. Towhidul Islam Tonmoy Aman Chadha Mikel Artetxe Punit Daniel Simig HILM 94 131 0 08 Oct 2023
A New Dataset for End-to-End Sign Language Translation: The Greek Elementary School Dataset Andreas Voskou Konstantinos P. Panousis Harris Partaourides Kyriakos Tolias S. Chatzis SLR 91 6 0 07 Oct 2023
A Comprehensive Evaluation of Large Language Models on Benchmark Biomedical Text Processing Tasks Fangshuo Liao Md Tahmid Rahman Laskar Cruz Barnum Jimmy Xiangji Huang AI4MH LM&MA 97 82 0 06 Oct 2023
Decision ConvFormer: Local Filtering in MetaFormer is Sufficient for Decision Making Jeonghye Kim Suyoung Lee Woojun Kim Young-Jin Sung OffRL 102 19 0 04 Oct 2023
ResidualTransformer: Residual Low-Rank Learning with Weight-Sharing for Transformer Layers Yiming Wang Jinyu Li 54 6 0 03 Oct 2023
ScaleNet: An Unsupervised Representation Learning Method for Limited Information Huili Huang M. M. Roozbahani SSL 127 804 0 03 Oct 2023
Selective Feature Adapter for Dense Vision Transformers XueQing Deng Qi Fan Xiaojie Jin Linjie Yang Peng Wang 61 0 0 03 Oct 2023
Zero-Shot Continuous Prompt Transfer: Generalizing Task Semantics Across Language Models Zijun Wu Yongkang Wu Lili Mou VLM 79 5 0 02 Oct 2023
From Bricks to Bridges: Product of Invariances to Enhance Latent Space Communication Irene Cannistraci Luca Moschella Marco Fumero Valentino Maiorca Emanuele Rodolà 108 14 0 02 Oct 2023
Improving Length-Generalization in Transformers via Task Hinting Pranjal Awasthi Anupam Gupta 76 9 0 01 Oct 2023
RelBERT: Embedding Relations with Language Models Asahi Ushio Jose Camacho-Collados Steven Schockaert KELM 80 1 0 30 Sep 2023
KLoB: a Benchmark for Assessing Knowledge Locating Methods in Language Models Yiming Ju Zheng Zhang KELM 58 9 0 28 Sep 2023
ELIP: Efficient Language-Image Pre-training with Fewer Vision Tokens Yangyang Guo Haoyu Zhang Yongkang Wong Liqiang Nie Mohan Kankanhalli VLM 69 3 0 28 Sep 2023
Question answering using deep learning in low resource Indian language Marathi Dhiraj Amin S. Govilkar Sagar Kulkarni 46 3 0 27 Sep 2023
Identifying and Mitigating Privacy Risks Stemming from Language Models: A Survey Victoria Smith Ali Shahin Shamsabadi Carolyn Ashurst Adrian Weller PILM 97 27 0 27 Sep 2023
Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Prompting Chao-Han Huck Yang Yile Gu Yi-Chieh Liu Shalini Ghosh I. Bulyko A. Stolcke KELM LRM 118 52 0 27 Sep 2023
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning Jiadong Wang Chengyu Wang Chuanqi Tan Jun Huang Ming Gao KELM 96 6 0 26 Sep 2023
LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression Ayush Kaushal Tejas Vaidhya Irina Rish 121 16 0 25 Sep 2023
Investigating Large Language Models and Control Mechanisms to Improve Text Readability of Biomedical Abstracts Z. Li Samuel Belkadi Nicolo Micheletti Lifeng Han Matthew Shardlow Goran Nenadic 98 5 0 22 Sep 2023
TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance Kan Wu Houwen Peng Zhenghong Zhou Bin Xiao Mengchen Liu ... Xi Xi Chen Xinggang Wang Hongyang Chao Han Hu VLM OODD 86 64 0 21 Sep 2023
Towards Answering Health-related Questions from Medical Videos: Datasets and Approaches Deepak Gupta Kush Attal Dina Demner-Fushman LM&MA 49 1 0 21 Sep 2023
BELT:Bootstrapping Electroencephalography-to-Language Decoding and Zero-Shot Sentiment Classification by Natural Language Supervision Jinzhao Zhou Yiqun Duan Yu-Cheng Chang Yu-Kai Wang Chin-Teng Lin 74 6 0 21 Sep 2023
DimCL: Dimensional Contrastive Learning For Improving Self-Supervised Learning Thanh Nguyen T. Pham Chaoning Zhang Tung M. Luu Thang Vu Chang D. Yoo 102 10 0 21 Sep 2023
Long-tail Augmented Graph Contrastive Learning for Recommendation Qian Zhao Zhengwei Wu Qing Cui Jun Zhou 24 5 0 20 Sep 2023
Heterogeneous Entity Matching with Complex Attribute Associations using BERT and Neural Networks Shitao Wang Jiamin Lu 23 1 0 20 Sep 2023
A Family of Pretrained Transformer Language Models for Russian Dmitry Zmitrovich Alexander Abramov Andrey Kalmykov Maria Tikhonova Ekaterina Taktasheva ... Vitalii Kadulin Sergey Markov Tatiana Shavrina Vladislav Mikhailov Alena Fenogenova 99 26 0 19 Sep 2023
Artificial Intelligence-Enabled Intelligent Assistant for Personalized and Adaptive Learning in Higher Education Ramteja Sajja Y. Sermet Muhammed Cikmaz David M. Cwiertny Ibrahim Demir 101 149 0 19 Sep 2023
A Neighbourhood-Aware Differential Privacy Mechanism for Static Word Embeddings Danushka Bollegala Shuichi Otake T. Machide Ken-ichi Kawarabayashi 136 4 0 19 Sep 2023
Model Leeching: An Extraction Attack Targeting LLMs Lewis Birch William Hackett Stefan Trawicki N. Suri Peter Garraghan 83 13 0 19 Sep 2023
Generative modeling, design and analysis of spider silk protein sequences for enhanced mechanical properties Wei Lu David L. Kaplan Markus J. Buehler 69 34 0 18 Sep 2023
Multi-turn Dialogue Comprehension from a Topic-aware Perspective Xinbei Ma Yi Xu Hai Zhao Zhuosheng Zhang 79 5 0 18 Sep 2023
Are You Worthy of My Trust?: A Socioethical Perspective on the Impacts of Trustworthy AI Systems on the Environment and Human Society Jamell Dacon SILM 100 1 0 18 Sep 2023
Pedestrian Trajectory Prediction Using Dynamics-based Deep Learning Honghui Wang Weiming Zhi Gustavo Batista Rohitash Chandra 54 1 0 16 Sep 2023
Fake News Detectors are Biased against Texts Generated by Large Language Models Jinyan Su Terry Yue Zhuo Jonibek Mansurov Di Wang Preslav Nakov DeLMO 60 17 0 15 Sep 2023
How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Study Andreas Waldis Yufang Hou Iryna Gurevych 62 4 0 15 Sep 2023
Do Generative Large Language Models need billions of parameters? Sia Gholami Marwan Omar 97 19 0 12 Sep 2023
Leveraging Large Language Models and Weak Supervision for Social Media data annotation: an evaluation using COVID-19 self-reported vaccination tweets Ramya Tekumalla Juan M. Banda 51 8 0 12 Sep 2023
Balanced and Explainable Social Media Analysis for Public Health with Large Language Models Yan Jiang Ruihong Qiu Yi Zhang Peng Zhang 65 7 0 12 Sep 2023
Incorporating Pre-trained Model Prompting in Multimodal Stock Volume Movement Prediction Ruibo Chen Zhiyuan Zhang Yi Liu Ruihan Bao Keiko Harimoto Xu Sun AIFin AI4TS 76 0 0 11 Sep 2023
Black-Box Analysis: GPTs Across Time in Legal Textual Entailment Task Nguyen Ha Thanh Randy Goebel Francesca Toni Kostas Stathis Ken Satoh AILaw ELM 40 3 0 11 Sep 2023
CrisisTransformers: Pre-trained language models and sentence encoders for crisis-related social media texts Rabindra Lamsal M. Read S. Karunasekera 49 15 0 11 Sep 2023
Retrieval-Augmented Meta Learning for Low-Resource Text Classification Rongsheng Li Yongqian Li Hai-Tao Zheng Chaiyut Luoyiching Hai-Tao Zheng Nannan Zhou Hanjing Su RALM 81 2 0 10 Sep 2023