SciBERT: A Pretrained Language Model for Scientific Text

26 March 2019

Kyle Lo

Arman Cohan

Papers citing "SciBERT: A Pretrained Language Model for Scientific Text"

50 / 452 papers shown

Title
CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understanding Dustin Wright Isabelle Augenstein 16 24 0 23 May 2021
CoTexT: Multi-task Learning with Code-Text Transformer Long Phan H. Tran Daniel Le Hieu Duy Nguyen J. Anibal Alec Peltekian Yanfang Ye 27 135 0 18 May 2021
Encoding Explanatory Knowledge for Zero-shot Science Question Answering Zili Zhou Marco Valentino Dónal Landers André Freitas 11 7 0 12 May 2021
Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents Chaojun Xiao Xueyu Hu Zhiyuan Liu Cunchao Tu Maosong Sun AILaw ELM 48 229 0 09 May 2021
Improving BERT Model Using Contrastive Learning for Biomedical Relation Extraction P. Su Yifan Peng K. Vijay-Shanker SSL 34 35 0 28 Apr 2021
SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts Arie Cattan Sophie Johnson Daniel S. Weld Ido Dagan Iz Beltagy Doug Downey Tom Hope 28 23 0 18 Apr 2021
Membership Inference Attack Susceptibility of Clinical Language Models Abhyuday N. Jagannatha Bhanu Pratap Singh Rawat Hong-ye Yu MIACV 29 62 0 16 Apr 2021
AMMU : A Survey of Transformer-based Biomedical Pretrained Language Models Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha LM&MA MedIm 28 164 0 16 Apr 2021
Flexible Instance-Specific Rationalization of NLP Models G. Chrysostomou Nikolaos Aletras 31 14 0 16 Apr 2021
ExplainaBoard: An Explainable Leaderboard for NLP Pengfei Liu Jinlan Fu Yanghua Xiao Weizhe Yuan Shuaichen Chang Junqi Dai Yixin Liu Zihuiwen Ye Zi-Yi Dou Graham Neubig XAI LRM ELM 33 54 0 13 Apr 2021
Semantic maps and metrics for science Semantic maps and metrics for science using deep transformer encoders Brendan Chambers James A. Evans MedIm 13 0 0 13 Apr 2021
Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviews M. Hadi Fatemeh H. Fard 26 30 0 12 Apr 2021
DATE: Detecting Anomalies in Text via Self-Supervision of Transformers Andrei Manolache Florin Brad Elena Burceanu UQCV 40 33 0 12 Apr 2021
UPB at SemEval-2021 Task 8: Extracting Semantic Information on Measurements as Multi-Turn Question Answering Andrei-Marius Avram George-Eduard Zaharia Dumitru-Clementin Cercel M. Dascalu 24 2 0 09 Apr 2021
BERT: A Review of Applications in Natural Language Processing and Understanding M. V. Koroteev VLM 25 197 0 22 Mar 2021
Identifying Machine-Paraphrased Plagiarism Jan Philip Wahle Terry Ruas Tomávs Foltýnek Norman Meuschke Bela Gipp 11 30 0 22 Mar 2021
AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarization Tiezheng Yu Zihan Liu Pascale Fung CLL 46 81 0 21 Mar 2021
Is BERT a Cross-Disciplinary Knowledge Learner? A Surprising Finding of Pre-trained Models' Transferability Wei-Tsung Kao Hung-yi Lee 16 16 0 12 Mar 2021
OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Services Xiao Liu Da Yin Jingnan Zheng Xingjian Zhang Peng Zhang Hongxia Yang Yuxiao Dong Jie Tang VLM 45 30 0 03 Mar 2021
Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction Benfeng Xu Quan Wang Yajuan Lyu Yong Zhu Zhendong Mao 27 166 0 20 Feb 2021
Boosting Low-Resource Biomedical QA via Entity-Aware Masking Strategies Gabriele Pergola E. Kochkina Lin Gui Maria Liakata Yulan He 88 31 0 16 Feb 2021
Cross-Domain Multi-Task Learning for Sequential Sentence Classification in Research Papers Arthur Brack Anett Hoppe Pascal Buschermöhle Ralph Ewerth 27 18 0 11 Feb 2021
Biomedical Question Answering: A Survey of Approaches and Challenges Qiao Jin Zheng Yuan Guangzhi Xiong Qian Yu Huaiyuan Ying Chuanqi Tan Mosha Chen Songfang Huang Xiaozhong Liu Sheng Yu 29 96 0 10 Feb 2021
Can We Automate Scientific Reviewing? Weizhe Yuan Pengfei Liu Graham Neubig 85 84 0 30 Jan 2021
CD2CR: Co-reference Resolution Across Documents and Domains James Ravenscroft Arie Cattan A. Clare Ido Dagan Maria Liakata 88 8 0 29 Jan 2021
A Survey on Extraction of Causal Relations from Natural Language Text Jie Yang S. Han Josiah Poon 3DV CML 101 85 0 16 Jan 2021
COVID-19: Comparative Analysis of Methods for Identifying Articles Related to Therapeutics and Vaccines without Using Labeled Data Mihir Parmar Ashwin Karthik Ambalavanan Hong Guan Rishab Banerjee Jitesh Pabla M. Devarakonda 23 0 0 05 Jan 2021
Learning to Emphasize: Dataset and Shared Task Models for Selecting Emphasis in Presentation Slides Amirreza Shirani Gia-Lac Tran Hieu Trinh Franck Dernoncourt Nedim Lipka P. Asente J. Echevarria Thamar Solorio 184 1 0 02 Jan 2021
MELINDA: A Multimodal Dataset for Biomedical Experiment Method Classification Te-Lin Wu Shikhar Singh S. Paul Gully A. Burns Nanyun Peng 30 18 0 16 Dec 2020
CrossNER: Evaluating Cross-Domain Named Entity Recognition Zihan Liu Yan Xu Tiezheng Yu Wenliang Dai Ziwei Ji Samuel Cahyawijaya Andrea Madotto Pascale Fung 78 146 0 08 Dec 2020
COVIDScholar: An automated COVID-19 research aggregation and analysis platform Amalie Trewartha John Dagdelen Haoyan Huo Kevin Cruse Zheren Wang ... Akshay Subramanian Yuxing Fei Benjamin Justus Kristin A. Persson Gerbrand Ceder 33 20 0 07 Dec 2020
End-to-End QA on COVID-19: Domain Adaptation with Synthetic Training R. Reddy Bhavani Iyer Md Arafat Sultan Rong Zhang Avirup Sil Vittorio Castelli Radu Florian Salim Roukos OOD 20 19 0 02 Dec 2020
CovidExplorer: A Multi-faceted AI-based Search and Visualization Engine for COVID-19 Information Heer Ambavi Kavita Vaishnaw Udit Vyas Abhisht Tiwari M. Singh 25 3 0 30 Nov 2020
AutoNLU: An On-demand Cloud-based Natural Language Understanding System for Enterprises Nham Le T. Lai Trung Bui Doo Soon Kim 23 0 0 26 Nov 2020
Biomedical Named Entity Recognition at Scale Veysel Kocaman D. Talby 25 67 0 12 Nov 2020
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search Chenyan Xiong Zhenghao Liu Si Sun Zhuyun Dai Kaitao Zhang S. Yu Zhiyuan Liu Hoifung Poon Jianfeng Gao Paul N. Bennett 30 10 0 03 Nov 2020
Topic-Centric Unsupervised Multi-Document Summarization of Scientific and News Articles Amanuel Alambo Cori Lohstroh Erik Madaus Swati Padhee Brandy Foster Tanvi Banerjee K. Thirunarayan M. Raymer 30 15 0 03 Nov 2020
A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Models Usman Naseem Imran Razzak S. Khan M. Prasad 14 156 0 28 Oct 2020
Multi-XScience: A Large-scale Dataset for Extreme Multi-document Summarization of Scientific Articles Yao Lu Yue Dong Laurent Charlin AILaw 26 113 0 27 Oct 2020
A Frustratingly Easy Approach for Entity and Relation Extraction Zexuan Zhong Danqi Chen 162 108 0 24 Oct 2020
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios Michael A. Hedderich Lukas Lange Heike Adel Jannik Strötgen Dietrich Klakow 221 287 0 23 Oct 2020
Unsupervised Data Augmentation with Naive Augmentation and without Unlabeled Data David Lowell Brian Howard Zachary Chase Lipton Byron C. Wallace 27 23 0 22 Oct 2020
An Analysis of Simple Data Augmentation for Named Entity Recognition Xiang Dai Heike Adel 35 194 0 22 Oct 2020
Document-Level Relation Extraction with Adaptive Thresholding and Localized Context Pooling Wenxuan Zhou Kevin Huang Tengyu Ma Jing Huang 24 273 0 21 Oct 2020
Explainable Automated Fact-Checking for Public Health Claims Neema Kotonya Francesca Toni 218 250 0 19 Oct 2020
Cold-start Active Learning through Self-supervised Language Modeling Michelle Yuan Hsuan-Tien Lin Jordan L. Boyd-Graber 116 180 0 19 Oct 2020
SciSummPip: An Unsupervised Scientific Paper Summarization Pipeline Jiaxin Ju Ming Liu Longxiang Gao Shirui Pan 68 13 0 19 Oct 2020
TweetBERT: A Pretrained Language Representation Model for Twitter Text Analysis Mohiuddin Md Abdul Qudar Vijay K. Mago SSeg 28 35 0 17 Oct 2020
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 244 612 0 13 Oct 2020
BioMegatron: Larger Biomedical Domain Language Model Hoo-Chang Shin Yang Zhang Evelina Bakhturina Raul Puri M. Patwary M. Shoeybi Raghav Mani AI4CE 24 144 0 12 Oct 2020