How to Fine-Tune BERT for Text Classification?

14 May 2019

Chi Sun

Xipeng Qiu

Yige Xu

Xuanjing Huang

ArXiv PDF HTML

Papers citing "How to Fine-Tune BERT for Text Classification?"

50 / 161 papers shown

Title
Prediction-powered estimators for finite population statistics in highly imbalanced textual data: Public hate crime estimation Hannes Waldetoft Jakob Torgander Måns Magnusson 34 0 0 05 May 2025
On the effectiveness of Large Language Models in the mechanical design domain Daniele Grandi Fabian Riquelme 29 0 0 02 May 2025
Preserving Privacy and Utility in LLM-Based Product Recommendations Tina Khezresmaeilzadeh Jiang Zhang Dimitrios Andreadis Konstantinos Psounis 37 0 0 02 May 2025
Automated Generation of Precedence Graphs in Digital Value Chains for Automotive Production Cornelius Hake Christian Friedrich 24 0 0 28 Apr 2025
Cost-Effective Text Clustering with Large Language Models Hongtao Wang Taiyan Zhang Renchi Yang Jianliang Xu 36 0 0 22 Apr 2025
Using machine learning to measure evidence of students' sensemaking in physics courses Kaitlin Gili Kyle Heuton Astha Shah Michael C. Hughes 51 0 0 19 Mar 2025
Stay Focused: Problem Drift in Multi-Agent Debate Jonas Becker Lars Benedikt Kaesberg Andreas Stephan Jan Philip Wahle Terry Ruas Bela Gipp 59 1 0 26 Feb 2025
Rule-ATT&CK Mapper (RAM): Mapping SIEM Rules to TTPs Using LLMs Prasanna N. Wudali Moshe Kravchik Ehud Malul Parth A. Gandhi Yuval Elovici A. Shabtai 46 0 0 04 Feb 2025
Detecting harassment and defamation in cyberbullying with emotion-adaptive training Peiling Yi A. Zubiaga Yunfei Long 87 0 0 28 Jan 2025
SCCD: A Session-based Dataset for Chinese Cyberbullying Detection Qingpo Yang Yakai Chen Zihui Xu Yu-ming Shang Sanchuan Guo Xi Zhang 44 1 0 28 Jan 2025
Comparative Approaches to Sentiment Analysis Using Datasets in Major European and Arabic Languages Mikhail Krasitskii Olga Kolesnikova Liliana Chanona Hernandez Grigori Sidorov Alexander Gelbukh 71 2 0 21 Jan 2025
A Hessian-informed hyperparameter optimization for differential learning rate Shiyun Xu Zhiqi Bu Yiliang Zhang Ian Barnett 46 1 0 12 Jan 2025
LLM Content Moderation and User Satisfaction: Evidence from Response Refusals in Chatbot Arena Stefan Pasch 40 0 0 04 Jan 2025
Vulnerability of LLMs to Vertically Aligned Text Manipulations Zhecheng Li Yansen Wang Bryan Hooi Yujun Cai Zhen Xiong Nanyun Peng Kai-Wei Chang 71 1 0 26 Oct 2024
Towards Supervised Performance on Speaker Verification with Self-Supervised Learning by Leveraging Large-Scale ASR Models Victor Miara Theo Lepage Reda Dehak 37 1 0 04 Jun 2024
Transformer and Hybrid Deep Learning Based Models for Machine-Generated Text Detection Teodor-George Marchitan Claudiu Creanga Liviu P. Dinu DeLMO 31 1 0 28 May 2024
Large Language Models for Cyber Security: A Systematic Literature Review HanXiang Xu Shenao Wang Ningke Li Kailong Wang Yanjie Zhao Kai Chen Ting Yu Yang Liu Haoyu Wang 42 29 0 08 May 2024
QuakeBERT: Accurate Classification of Social Media Texts for Rapid Earthquake Impact Assessment Jin Han Zhe Zheng Xin-Zheng Lu Ke-Yin Chen Jia-Rui Lin 19 5 0 06 May 2024
FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models Zhuohao Yu Chang Gao Wenjin Yao Yidong Wang Zhengran Zeng Wei Ye Jindong Wang Yue Zhang Shikun Zhang 46 1 0 09 Apr 2024
"My agent understands me better": Integrating Dynamic Human-like Memory Recall and Consolidation in LLM-Based Agents Yuki Hou Haruki Tamoto Homei Miyashita LLMAG 33 23 0 31 Mar 2024
Investigating Text Shortening Strategy in BERT: Truncation vs Summarization Mirza Alim Mutasodirin Radityo Eko Prasojo 29 8 0 19 Mar 2024
LegalLens: Leveraging LLMs for Legal Violation Identification in Unstructured Text Dor Bernsohn Gil Semo Yaron Vazana Gila Hayat Ben Hagag Joel Niklaus Rohit Saha Kyryl Truskovskyi AILaw 22 17 0 06 Feb 2024
AlbNews: A Corpus of Headlines for Topic Modeling in Albanian Erion Çano Dario Lamaj 32 1 0 06 Feb 2024
Credit Risk Meets Large Language Models: Building a Risk Indicator from Loan Descriptions in P2P Lending Mario Sanz-Guerrero Javier Arroyo 36 4 0 29 Jan 2024
Well-calibrated Confidence Measures for Multi-label Text Classification with a Large Number of Labels L. Maltoudoglou A. Paisios Ladislav Lenc J. Martínek Pavel Král Harris Papadopoulos 24 41 0 14 Dec 2023
Efficient Rehearsal Free Zero Forgetting Continual Learning using Adaptive Weight Modulation Yonatan Sverdlov Shimon Ullman 34 0 0 26 Nov 2023
Efficient Trigger Word Insertion Yueqi Zeng Ziqiang Li Pengfei Xia Lei Liu Bin Li AAML 21 5 0 23 Nov 2023
Hashing it Out: Predicting Unhealthy Conversations on Twitter Steven Leung Filippos Papapolyzos 18 1 0 17 Nov 2023
DeepLearningBrasil@LT-EDI-2023: Exploring Deep Learning Techniques for Detecting Depression in Social Media Text E. Garcia Juliana Resplande SantÁnna Gomes Adalberto Ferreira Barbosa Junior Cardeque Borges Nádia Félix F. da Silva 11 1 0 08 Nov 2023
Balanced and Explainable Social Media Analysis for Public Health with Large Language Models Yan Jiang Ruihong Qiu Yi Zhang Peng Zhang 27 7 0 12 Sep 2023
Measuring Catastrophic Forgetting in Cross-Lingual Transfer Paradigms: Exploring Tuning Strategies Boshko Koloski Blaž Škrlj Marko Robnik-Šikonja Senja Pollak CLL 27 2 0 12 Sep 2023
Differentiable Retrieval Augmentation via Generative Language Modeling for E-commerce Query Intent Classification Chenyu Zhao Yunjiang Jiang Yiming Qiu Han Zhang Wen-Yun Yang RALM 34 5 0 18 Aug 2023
A Side-by-side Comparison of Transformers for English Implicit Discourse Relation Classification Bruce W. Lee Bongseok Yang J. Lee 16 0 0 07 Jul 2023
Ticket-BERT: Labeling Incident Management Tickets with Language Models Zhexiong Liu Cris Benge Siduo Jiang VLM 17 4 0 30 Jun 2023
Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models Guande He Jianfei Chen Jun Zhu 45 20 0 30 May 2023
Investigating the Role of Feed-Forward Networks in Transformers Using Parallel Attention and Feed-Forward Net Design Shashank Sonkar Richard G. Baraniuk 19 3 0 22 May 2023
Text2Gender: A Deep Learning Architecture for Analysis of Blogger's Age and Gender Vishesh Thakur Aneesh Tickoo 13 1 0 15 May 2023
A Method to Automate the Discharge Summary Hospital Course for Neurology Patients Vince C. Hartman Sanika S. Bapat M. Weiner B. Navi E. Sholle T. Campion 32 18 0 10 May 2023
The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classification Anastasiia Grishina Max Hort Leon Moonen 22 7 0 08 May 2023
Are the Best Multilingual Document Embeddings simply Based on Sentence Embeddings? Sonal Sannigrahi Josef van Genabith C. España-Bonet AILaw 42 4 0 28 Apr 2023
Multi-Modal Deep Learning for Credit Rating Prediction Using Text and Numerical Data Streams M. Tavakoli Rohitash Chandra Fengrui Tian Cristián Bravo 31 8 0 21 Apr 2023
MasakhaNEWS: News Topic Classification for African languages David Ifeoluwa Adelani Marek Masiak Israel Abebe Azime Jesujoba Oluwadara Alabi A. Tonja ... Moges Ahmed Mehamed Evrard Ngabire Jules Jules Ivan Ssenkungu Pontus Stenetorp 28 24 0 19 Apr 2023
Covidia: COVID-19 Interdisciplinary Academic Knowledge Graph Cheng Deng Jiaxin Ding Luoyi Fu Weinan Zhang Xinbing Wang Cheng Zhou 16 2 0 14 Apr 2023
Global Prompt Cell: A Portable Control Module for Effective Prompt Tuning Chi-Liang Liu Hao Wang Nuwa Xi Sendong Zhao Bing Qin VLM 21 1 0 12 Apr 2023
Continual Graph Convolutional Network for Text Classification Tiandeng Wu Qijiong Liu Yinhao Cao yao. huang Xiao-Ming Wu Jiandong Ding GNN 40 10 0 09 Apr 2023
Learning to Explore Informative Trajectories and Samples for Embodied Perception Ya Jing Tao Kong 27 5 0 20 Mar 2023
Automatically Identifying Relations Between Self-Admitted Technical Debt Across Different Sources Yikun Li Mohamed Soliman P. Avgeriou 30 2 0 13 Mar 2023
How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language Understanding Tasks Xuanting Chen Junjie Ye Can Zu Nuo Xu Rui Zheng Minlong Peng Jie Zhou Tao Gui Qi Zhang Xuanjing Huang AI4MH ELM 36 79 0 01 Mar 2023
Mask-guided BERT for Few Shot Text Classification Wenxiong Liao Zheng Liu Haixing Dai Zihao Wu Yiyang Zhang ... Dajiang Zhu Tianming Liu Sheng Li Xiang Li Hongmin Cai VLM 47 39 0 21 Feb 2023
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection Chenglong Wang Yi Lu Yongyu Mu Yimin Hu Tong Xiao Jingbo Zhu 34 8 0 01 Feb 2023