How to Fine-Tune BERT for Text Classification?

14 May 2019

Chi Sun

Xipeng Qiu

Yige Xu

Xuanjing Huang

ArXiv PDF HTML

Papers citing "How to Fine-Tune BERT for Text Classification?"

50 / 169 papers shown

Title
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection Chenglong Wang Yi Lu Yongyu Mu Yimin Hu Tong Xiao Jingbo Zhu 40 8 0 01 Feb 2023
Adapting Multilingual Speech Representation Model for a New, Underresourced Language through Multilingual Fine-tuning and Continued Pretraining Karol Nowakowski M. Ptaszynski Kyoko Murasaki Jagna Nieuwazny 23 24 0 18 Jan 2023
Fruit Ripeness Classification: a Survey Matteo Rizzo Matteo Marcuzzo A. Zangari A. Gasparetto A. Albarelli 29 62 0 29 Dec 2022
Exploiting Rich Textual User-Product Context for Improving Sentiment Analysis Chenyang Lyu Linyi Yang Yue Zhang Yvette Graham Jennifer Foster 26 1 0 17 Dec 2022
TweetDrought: A Deep-Learning Drought Impacts Recognizer based on Twitter Data Beichen Zhang Frank Schilder K. Smith M. Hayes Sherri K. Harms T. Tadesse 24 6 0 07 Dec 2022
CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domain Markus Bayer Philip D. . Kuehn Ramin Shanehsaz Christian A. Reuter 15 43 0 06 Dec 2022
Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets Fabian Karl A. Scherp VLM 24 20 0 30 Nov 2022
Exploiting Transformer-based Multitask Learning for the Detection of Media Bias in News Articles Timo Spinde Jan-David Krieger Terry Ruas Jelena Mitrović Franz Götz-Hahn Akiko Aizawa Bela Gipp 35 27 0 07 Nov 2022
BERT-Deep CNN: State-of-the-Art for Sentiment Analysis of COVID-19 Tweets Javad Hassannataj Joloudari Sadiq Hussain M. Nematollahi Rouhollah Bagheri Fatemeh Fazl R. Alizadehsani Reza Lashgari Ashis Talukder 18 39 0 04 Nov 2022
WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domain Raj Sanjay Shah Kunal Chawla Dheeraj Eidnani Agam Shah Wendi Du Sudheer Chava Natraj Raman Charese Smiley Jiaao Chen Diyi Yang AIFin 37 104 0 31 Oct 2022
Learning New Tasks from a Few Examples with Soft-Label Prototypes Avyav Kumar Singh Ekaterina Shutova H. Yannakoudakis VLM 42 0 0 31 Oct 2022
RoChBert: Towards Robust BERT Fine-tuning for Chinese Zihan Zhang Jinfeng Li Ning Shi Bo Yuan Xiangyu Liu Rong Zhang Hui Xue Donghong Sun Chao Zhang AAML 34 4 0 28 Oct 2022
A BERT-based Deep Learning Approach for Reputation Analysis in Social Media Mohammad Wali Ur Rahman Sicong Shao Pratik Satam Salim Hariri Chris Padilla Zoe Taylor C. Nevarez 25 5 0 23 Oct 2022
Learning to Invert: Simple Adaptive Attacks for Gradient Inversion in Federated Learning Ruihan Wu Xiangyu Chen Chuan Guo Kilian Q. Weinberger FedML 20 26 0 19 Oct 2022
KSAT: Knowledge-infused Self Attention Transformer -- Integrating Multiple Domain-Specific Contexts Kaushik Roy Yuxin Zi Vignesh Narayanan Manas Gaur Amit P. Sheth AI4MH 46 12 0 09 Oct 2022
Mapping STI ecosystems via Open Data: overcoming the limitations of conflicting taxonomies. A case study for Climate Change Research in Denmark N. Bovenzi Nicolau Duran-Silva F. Massucci Francesco Multari Cèsar Parra-Rojas Josep Pujol-Llatse 16 0 0 19 Sep 2022
Linear Transformations for Cross-lingual Sentiment Analysis Pavel Přibáň Jakub Šmíd Adam Mištera Pavel Král 26 3 0 15 Sep 2022
CNN-Trans-Enc: A CNN-Enhanced Transformer-Encoder On Top Of Static BERT representations for Document Classification Charaf Eddine Benarab Shenglin Gui 29 6 0 13 Sep 2022
SkIn: Skimming-Intensive Long-Text Classification Using BERT for Medical Corpus Yufeng Zhao Haiying Che VLM 29 0 0 13 Sep 2022
SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning Wei Han Hui Chen Zhen Hai Soujanya Poria Lidong Bing 66 16 0 12 Sep 2022
Trigger Warnings: Bootstrapping a Violence Detector for FanFiction Magdalena Wolska Christopher Schröder Ole Borchardt Benno Stein Martin Potthast 23 9 0 09 Sep 2022
Efficient NLP Model Finetuning via Multistage Data Filtering Ouyang Xu S. Ansari F. Lin Yangfeng Ji 45 2 0 28 Jul 2022
Heuristic-free Optimization of Force-Controlled Robot Search Strategies in Stochastic Environments Bastian Alt Darko Katic Rainer Jäkel Michael Beetz 27 6 0 15 Jul 2022
Beware the Rationalization Trap! When Language Model Explainability Diverges from our Mental Models of Language Rita Sevastjanova Mennatallah El-Assady LRM 40 9 0 14 Jul 2022
PLM-ICD: Automatic ICD Coding with Pretrained Language Models Chao-Wei Huang Shang-Chi Tsai Yun-Nung Chen 43 49 0 12 Jul 2022
Multimodal E-Commerce Product Classification Using Hierarchical Fusion Tsegaye Misikir Tashu Sara Fattouh Peter Kiss Tomáš Horváth 27 1 0 07 Jul 2022
Knowledge Graph Fusion for Language Model Fine-tuning Nimesh Bhana Terence L van Zyl 19 0 0 21 Jun 2022
Estimating Confidence of Predictions of Individual Classifiers and Their Ensembles for the Genre Classification Task Mikhail Lepekhin S. Sharoff UQCV 21 5 0 15 Jun 2022
Task-Adaptive Pre-Training for Boosting Learning With Noisy Labels: A Study on Text Classification for African Languages D. Zhu Michael A. Hedderich Fangzhou Zhai David Ifeoluwa Adelani Dietrich Klakow NoLa 34 0 0 03 Jun 2022
A Comparison of Approaches for Imbalanced Classification Problems in the Context of Retrieving Relevant Documents for an Analysis Sandra Wankmüller 38 2 0 03 May 2022
Identifying and Characterizing Active Citizens who Refute Misinformation in Social Media Yida Mu Pu Niu Nikolaos Aletras 34 12 0 21 Apr 2022
Polling Latent Opinions: A Method for Computational Sociolinguistics Using Transformer Language Models Philip G. Feldman Aaron Dant James R. Foulds Shimei Pan 32 3 0 15 Apr 2022
Revisiting Transformer-based Models for Long Document Classification Xiang Dai Ilias Chalkidis S. Darkner Desmond Elliott VLM 25 68 0 14 Apr 2022
Team ÚFAL at CMCL 2022 Shared Task: Figuring out the correct recipe for predicting Eye-Tracking features using Pretrained Language Models Sunit Bhattacharya Rishu Kumar Ondrej Bojar 18 2 0 11 Apr 2022
Paying More Attention to Self-attention: Improving Pre-trained Language Models via Attention Guiding Shanshan Wang Zhumin Chen Zhaochun Ren Huasheng Liang Qiang Yan Pengjie Ren 33 9 0 06 Apr 2022
Graph Enhanced BERT for Query Understanding Juanhui Li Yao Ma Weizhen Zeng Suqi Cheng Jiliang Tang Shuaiqiang Wang Dawei Yin 29 7 0 03 Apr 2022
Immersive Text Game and Personality Classification Wanshui Li Yifan Bai Jiaxuan Lu Kexin Yi LLMAG AI4CE 33 1 0 20 Mar 2022
Improving Health Mentioning Classification of Tweets using Contrastive Adversarial Training Pervaiz Iqbal Khan Shoaib Ahmed Siddiqui Imran Razzak Andreas Dengel Sheraz Ahmed 21 3 0 03 Mar 2022
NoisyTune: A Little Noise Can Help You Finetune Pretrained Language Models Better Chuhan Wu Fangzhao Wu Tao Qi Yongfeng Huang Xing Xie 27 58 0 24 Feb 2022
Prompt-Learning for Short Text Classification Yi Zhu Xinke Zhou Jipeng Qiang Yun Li Yunhao Yuan Xindong Wu VLM 18 34 0 23 Feb 2022
Zero-Shot Aspect-Based Sentiment Analysis Lei Shu Hu Xu Bing-Quan Liu Jiahua Chen 32 14 0 04 Feb 2022
Artefact Retrieval: Overview of NLP Models with Knowledge Base Access Vilém Zouhar Marius Mosbach Debanjali Biswas Dietrich Klakow KELM 34 4 0 24 Jan 2022
Clustering Vietnamese Conversations From Facebook Page To Build Training Dataset For Chatbot Tri Nguyen Thi-Kim-Ngoan Pham T. Bui Thanh-Quynh-Chau Nguyen 24 0 0 31 Dec 2021
Rank4Class: A Ranking Formulation for Multiclass Classification Nan Wang Zhen Qin Le Yan Honglei Zhuang Xuanhui Wang Michael Bendersky Marc Najork 32 3 0 17 Dec 2021
Improving the Question Answering Quality using Answer Candidate Filtering based on Natural-Language Features Aleksandr Gashkov A. Perevalov M. Eltsova A. Both 19 3 0 10 Dec 2021
Enhancing Identification of Structure Function of Academic Articles Using Contextual Information Bowen Ma Chengzhi Zhang Yuzhuo Wang Sanhong Deng 33 10 0 28 Nov 2021
The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning Raed Al Kontar Naichen Shi Xubo Yue Seokhyun Chung E. Byon ... Chinedum Okwudire Garvesh Raskutti R. Saigal Karandeep Singh Ye Zhisheng FedML 49 51 0 09 Nov 2021
Benchmarking Multimodal AutoML for Tabular Data with Text Fields Xingjian Shi Jonas W. Mueller Nick Erickson Mu Li Alexander J. Smola LMTD 48 29 0 04 Nov 2021
A Comparative Study of Speaker Role Identification in Air Traffic Communication Using Deep Learning Approaches Dongyue Guo Jianwei Zhang Bo Yang Yi Lin 27 10 0 03 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 85 1,039 0 01 Nov 2021