How to Fine-Tune BERT for Text Classification?

14 May 2019

Chi Sun

Xipeng Qiu

Yige Xu

Xuanjing Huang

ArXiv PDF HTML

Papers citing "How to Fine-Tune BERT for Text Classification?"

50 / 169 papers shown

Title
MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare Shaoxiong Ji Tianlin Zhang Luna Ansari Jie Fu Prayag Tiwari Min Zhang VLM AI4MH 33 223 0 29 Oct 2021
MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extraction Linhan Zhang Qian Chen Wen Wang Chong Deng Shiliang Zhang Bing Li Wei Wang Xin Cao 45 56 0 13 Oct 2021
K-Wav2vec 2.0: Automatic Speech Recognition based on Joint Decoding of Graphemes and Syllables Jounghee Kim Pilsung Kang VLM 29 6 0 11 Oct 2021
ALL-IN-ONE: Multi-Task Learning BERT models for Evaluating Peer Assessments Qinjin Jia Jiali Cui Yunkai Xiao Chengyuan Liu Parvez Rashid E. Gehringer 40 43 0 08 Oct 2021
BERT-Beta: A Proactive Probabilistic Approach to Text Moderation Fei Tan Yifan Hu Kevin Yen Changwei Hu 38 7 0 18 Sep 2021
The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classification Benjamin Clavié Marc Alphonsus ELM AILaw 37 10 0 15 Sep 2021
Residual Adapters for Parameter-Efficient ASR Adaptation to Atypical and Accented Speech Katrin Tomanek Vicky Zayats Dirk Padfield K. Vaillancourt Fadi Biadsy 59 57 0 14 Sep 2021
Improving Gradient-based Adversarial Training for Text Classification by Contrastive Learning and Auto-Encoder Yao Qiu Jinchao Zhang Jie Zhou AAML SILM 40 16 0 14 Sep 2021
Enhancing Natural Language Representation with Large-Scale Out-of-Domain Commonsense Wanyun Cui Xingran Chen 22 6 0 06 Sep 2021
Are the Multilingual Models Better? Improving Czech Sentiment with Transformers Pavel Přibáň J. Steinberger 36 11 0 24 Aug 2021
Back-Translated Task Adaptive Pretraining: Improving Accuracy and Robustness on Text Classification Junghoon Lee Jounghee Kim Pilsung Kang VLM 19 5 0 22 Jul 2021
Improved Text Classification via Contrastive Adversarial Training Lin Pan Chung-Wei Hang Avirup Sil Saloni Potdar AAML 28 86 0 21 Jul 2021
BERT Fine-Tuning for Sentiment Analysis on Indonesian Mobile Apps Reviews Kuncahyo Setyo Nugroho Anantha Yullian Sukmadewa DW HaftittahWuswilahaken F. A. Bachtiar N. Yudistira 18 43 0 14 Jul 2021
On the Lack of Robust Interpretability of Neural Text Classifiers Muhammad Bilal Zafar Michele Donini Dylan Slack Cédric Archambeau Sanjiv Ranjan Das K. Kenthapadi AAML 16 21 0 08 Jun 2021
Neural Models for Offensive Language Detection Ehab Hamdy 22 4 0 30 May 2021
Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality Adithya V Ganesan Matthew Matero Aravind Reddy Ravula Huy-Hien Vu H. Andrew Schwartz 30 35 0 07 May 2021
AraCOVID19-MFH: Arabic COVID-19 Multi-label Fake News and Hate Speech Detection Dataset Mohamed Seghir Hadj Ameur H. Aliane 18 18 0 07 May 2021
Improving the Faithfulness of Attention-based Explanations with Task-specific Information for Text Classification G. Chrysostomou Nikolaos Aletras 29 37 0 06 May 2021
MOROCCO: Model Resource Comparison Framework Valentin Malykh Alexander Kukushkin Ekaterina Artemova Vladislav Mikhailov Maria Tikhonova Tatiana Shavrina 24 0 0 29 Apr 2021
Adapting Long Context NLM for ASR Rescoring in Conversational Agents Ashish Shenoy S. Bodapati Monica Sunkara S. Ronanki Katrin Kirchhoff 34 21 0 21 Apr 2021
CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systems Kushal Chawla Jaysa Ramirez Rene Clever Gale M. Lucas Jonathan May Jonathan Gratch 23 51 0 29 Mar 2021
BERT: A Review of Applications in Natural Language Processing and Understanding M. V. Koroteev VLM 25 197 0 22 Mar 2021
L3CubeMahaSent: A Marathi Tweet-based Sentiment Analysis Dataset Atharva Kulkarni Meet Mandhane Manali Likhitkar G. Kshirsagar Raviraj Joshi 25 53 0 21 Mar 2021
Natural Language Understanding for Argumentative Dialogue Systems in the Opinion Building Domain W. A. Abro Annalena Aicher Niklas Rach Stefan Ultes Wolfgang Minker Guilin Qi 31 32 0 03 Mar 2021
On the Utility of Gradient Compression in Distributed Training Systems Saurabh Agarwal Hongyi Wang Shivaram Venkataraman Dimitris Papailiopoulos 41 46 0 28 Feb 2021
Self-Tuning for Data-Efficient Deep Learning Ximei Wang Jing Gao Mingsheng Long Jianmin Wang BDL 30 70 0 25 Feb 2021
ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaning Xin Xie Xiangnan Chen Xiang Chen Yong Wang Ningyu Zhang Shumin Deng Huajun Chen 42 2 0 25 Feb 2021
MUDES: Multilingual Detection of Offensive Spans Tharindu Ranasinghe Marcos Zampieri 27 41 0 18 Feb 2021
AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuning Yuhan Liu Saurabh Agarwal Shivaram Venkataraman OffRL 22 54 0 02 Feb 2021
EmpathBERT: A BERT-based Framework for Demographic-aware Empathy Prediction Bhanu Prakash Reddy Guda Aparna Garimella Niyati Chhaya 22 32 0 30 Jan 2021
Fake News Detection System using XLNet model with Topic Distributions: CONSTRAINT@AAAI2021 Shared Task Akansha Gautam Venktesh V Sarah Masud 10 32 0 12 Jan 2021
Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English Xiangyang Li Yu Xia Xiang Long Zheng Li Sujian Li 226 37 0 07 Jan 2021
Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning Daniel Grießhaber J. Maucher Ngoc Thang Vu 19 46 0 04 Dec 2020
Bangla Text Classification using Transformers Tanvirul Alam A. Khan Firoj Alam 31 34 0 09 Nov 2020
TransQuest: Translation Quality Estimation with Cross-lingual Transformers Tharindu Ranasinghe Constantin Orasan R. Mitkov ViT 22 108 0 01 Nov 2020
Hierarchical Metadata-Aware Document Categorization under Weak Supervision Yu Zhang Xiusi Chen Yu Meng Jiawei Han 43 22 0 26 Oct 2020
CRAB: Class Representation Attentive BERT for Hate Speech Identification in Social Media Sayyed M. Zahiri Ali Ahmadvand 20 4 0 25 Oct 2020
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding Dongling Xiao Yukun Li Han Zhang Yu Sun Hao Tian Hua Wu Haifeng Wang 27 38 0 23 Oct 2020
Improving BERT Performance for Aspect-Based Sentiment Analysis Akbar Karimi L. Rossi Andrea Prati 35 48 0 22 Oct 2020
Contrastive Cross-Modal Pre-Training: A General Strategy for Small Sample Medical Imaging G. Liang Connor Greenwell Yu Zhang Xiaoqin Wang Ramakanth Kavuluru Nathan Jacobs 42 21 0 06 Oct 2020
Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers Hanjie Chen Yangfeng Ji AAML VLM 15 63 0 01 Oct 2020
Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank Ethan C. Chau Lucy H. Lin Noah A. Smith 22 15 0 29 Sep 2020
I-AID: Identifying Actionable Information from Disaster-related Tweets Hamada M. Zahera Rricha Jalota M. A. Sherif A. N. Ngomo 19 13 0 04 Aug 2020
A System for Worldwide COVID-19 Information Aggregation Akiko Aizawa Frédéric Bergéron Junjie Chen Fei Cheng Katsuhiko Hayashi ... Masashi Toyoda Nobuhiro Ueda Honai Ueoka Masao Utiyama Ying Zhong 6 5 0 28 Jul 2020
Hierarchical Interaction Networks with Rethinking Mechanism for Document-level Sentiment Analysis Lingwei Wei Dou Hu Wei Zhou Xuehai Tang Xiaodan Zhang Xin Wang Jizhong Han Songlin Hu 38 11 0 16 Jul 2020
TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech Andy T. Liu Shang-Wen Li Hung-yi Lee SSL 62 356 0 12 Jul 2020
Natural Backdoor Attack on Text Data Lichao Sun SILM 19 39 0 29 Jun 2020
Revisiting Few-sample BERT Fine-tuning Tianyi Zhang Felix Wu Arzoo Katiyar Kilian Q. Weinberger Yoav Artzi 41 442 0 10 Jun 2020
CausaLM: Causal Model Explanation Through Counterfactual Language Models Amir Feder Nadav Oved Uri Shalit Roi Reichart CML LRM 49 157 0 27 May 2020
Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting Sanyuan Chen Yutai Hou Yiming Cui Wanxiang Che Ting Liu Xiangzhan Yu KELM CLL 21 214 0 27 Apr 2020