SciBERT: A Pretrained Language Model for Scientific Text

26 March 2019

Kyle Lo

Arman Cohan

Papers citing "SciBERT: A Pretrained Language Model for Scientific Text"

50 / 452 papers shown

Title
Predicting Clinical Trial Results by Implicit Evidence Integration Qiao Jin Chuanqi Tan Mosha Chen Xiaozhong Liu Songfang Huang 25 8 0 12 Oct 2020
Extracting a Knowledge Base of Mechanisms from COVID-19 Papers Tom Hope Aida Amini David Wadden Madeleine van Zuylen Sravanthi Parasa Eric Horvitz Daniel S. Weld Roy Schwartz Hannaneh Hajishirzi 34 29 0 08 Oct 2020
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition Yun He Ziwei Zhu Yin Zhang Qin Chen James Caverlee AI4MH 36 108 0 08 Oct 2020
Deep Anomaly Detection by Residual Adaptation Lucas Deecke Lukas Ruff Robert A. Vandermeulen Hakan Bilen UQCV 30 4 0 05 Oct 2020
An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot Labels Ilias Chalkidis Manos Fergadiotis Sotiris Kotitsas Prodromos Malakasiotis Nikolaos Aletras Ion Androutsopoulos VLM AI4TS 28 84 0 04 Oct 2020
Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media Xiang Dai Sarvnaz Karimi Ben Hachey Cécile Paris 24 35 0 02 Oct 2020
Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank Ethan C. Chau Lucy H. Lin Noah A. Smith 22 15 0 29 Sep 2020
Biomedical Event Extraction with Hierarchical Knowledge Graphs Kung-Hsiang Huang Mu Yang Nanyun Peng 19 29 0 20 Sep 2020
Extracting Summary Knowledge Graphs from Long Documents Zeqiu Wu Rik Koncel-Kedziorski Mari Ostendorf Hannaneh Hajishirzi 35 15 0 19 Sep 2020
MatScIE: An automated tool for the generation of databases of methods and parameters used in the computational materials science literature Souradip Guha Ankan Mullick Jatin Agrawal Swetarekha Ram Samir Ghui Seung-Cheol Lee S. Bhattacharjee Pawan Goyal 21 15 0 15 Sep 2020
UPB at SemEval-2020 Task 11: Propaganda Detection with Domain-Specific Trained BERT Andrei Paraschiv Dumitru-Clementin Cercel M. Dascalu 11 17 0 11 Sep 2020
Antibody Watch: Text Mining Antibody Specificity from the Literature Chun-Nan Hsu Chia-Hui Chang Thamolwan Poopradubsil Amanda Lo Karen A. William Ko-Wei Lin A. Bandrowski I. B. Ozyurt J. Grethe M. Martone 9 3 0 05 Aug 2020
COVID-19 therapy target discovery with context-aware literature mining Matej Martinc Blaž Škrlj S. Pirkmajer Nada Lavrac B. Cestnik Martin Marzidovsek Senja Pollak 9 9 0 30 Jul 2020
COVID-19 Knowledge Graph: Accelerating Information Retrieval and Discovery for Scientific Literature Colby Wise V. Ioannidis Miguel Calvo Rebollar Xiang Song George D. Price Ninad Kulkarni Ryan Brand Parminder Bhatia George Karypis 16 68 0 24 Jul 2020
Transferability of Natural Language Inference to Biomedical Question Answering Minbyul Jeong Mujeen Sung Gangwoo Kim Donghyeon Kim Wonjin Yoon J. Yoo Jaewoo Kang 19 38 0 01 Jul 2020
FinBERT: A Pretrained Language Model for Financial Communications Yi Yang Mark Christopher Siy Uy Allen H Huang AIFin AI4CE 28 230 0 15 Jun 2020
The SOFC-Exp Corpus and Neural Approaches to Information Extraction in the Materials Science Domain Annemarie Friedrich Heike Adel F. Tomazic Johannes Hingerl Renou Benteau Anika Maruscyk Lukas Lange 27 71 0 04 Jun 2020
Active Imitation Learning with Noisy Guidance Kianté Brantley Amr Sharaf Hal Daumé 27 23 0 26 May 2020
Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease prediction L. Rasmy Yang Xiang Z. Xie Cui Tao Degui Zhi AI4MH LM&MA 24 657 0 22 May 2020
BERTweet: A pre-trained language model for English Tweets Dat Quoc Nguyen Thanh Tien Vu A. Nguyen VLM 34 901 0 20 May 2020
Semi-Automating Knowledge Base Construction for Cancer Genetics Somin Wadhwa K. Yin K. Hughes Byron C. Wallace 22 0 0 17 May 2020
COVID-Twitter-BERT: A Natural Language Processing Model to Analyse COVID-19 Content on Twitter Martin Müller M. Salathé P. Kummervold VLM MedIm AI4MH 35 355 0 15 May 2020
BIOMRC: A Dataset for Biomedical Machine Reading Comprehension Petros Stavropoulos Dimitris Pappas Ion Androutsopoulos Ryan T. McDonald 24 50 0 13 May 2020
Evidence Inference 2.0: More Data, Better Models Jay DeYoung Eric P. Lehman Benjamin E. Nye Iain J. Marshall Byron C. Wallace 25 68 0 08 May 2020
CODA-19: Using a Non-Expert Crowd to Annotate Research Aspects on 10,000+ Abstracts in the COVID-19 Open Research Dataset Ting-Hao 'Kenneth' Huang Huang Chieh-Yang C. C. Ding Yen-Chia Hsu C. Lee Giles 27 14 0 05 May 2020
SLEDGE: A Simple Yet Effective Baseline for COVID-19 Scientific Knowledge Search Sean MacAvaney Arman Cohan Nazli Goharian 25 23 0 05 May 2020
ImpactCite: An XLNet-based method for Citation Impact Analysis Dominique Mercier Syed Tahseen Raza Rizvi Vikas Rajashekar Andreas Dengel Sheraz Ahmed 19 14 0 05 May 2020
SciREX: A Challenge Dataset for Document-Level Information Extraction Sarthak Jain Madeleine van Zuylen Hannaneh Hajishirzi Iz Beltagy 27 160 0 01 May 2020
Fact or Fiction: Verifying Scientific Claims David Wadden Shanchuan Lin Kyle Lo Lucy Lu Wang Madeleine van Zuylen Arman Cohan Hannaneh Hajishirzi HAI 36 430 0 30 Apr 2020
Natural Language Premise Selection: Finding Supporting Statements for Mathematical Text Deborah Ferreira André Freitas AIMat 17 32 0 30 Apr 2020
Train No Evil: Selective Masking for Task-Guided Pre-Training Yuxian Gu Zhengyan Zhang Xiaozhi Wang Zhiyuan Liu Maosong Sun 32 59 0 21 Apr 2020
Augmented Curation of Unstructured Clinical Notes from a Massive EHR System Reveals Specific Phenotypic Signature of Impending COVID-19 Diagnosis F. Shweta K. Murugadoss S. Awasthi A. Venkatakrishnan Arjun Puranik ... G. Gores A. Williams J. Halamka V. Soundararajan A. Badley 13 26 0 17 Apr 2020
Improving Scholarly Knowledge Representation: Evaluating BERT-based Models for Scientific Relation Classification Ming Jiang Jennifer D'Souza Sören Auer J. S. Downie 25 11 0 13 Apr 2020
Continual Domain-Tuning for Pretrained Language Models Subendhu Rongali Abhyuday N. Jagannatha Bhanu Pratap Singh Rawat Hong-ye Yu CLL KELM 14 7 0 05 Apr 2020
Deep Entity Matching with Pre-Trained Language Models Yuliang Li Jinfeng Li Yoshihiko Suhara A. Doan W. Tan VLM 28 373 0 01 Apr 2020
TNT-KID: Transformer-based Neural Tagger for Keyword Identification Matej Martinc Blaž Škrlj Senja Pollak 24 37 0 20 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 246 1,454 0 18 Mar 2020
Annotating and Extracting Synthesis Process of All-Solid-State Batteries from Scientific Literature Fusataka Kuniyoshi Kohei Makino Jun Ozawa Makoto Miwa 36 33 0 18 Feb 2020
Explaining Relationships Between Scientific Documents Kelvin Luu Xinyi Wu Rik Koncel-Kedziorski Kyle Lo Isabel Cachola Noah A. Smith 41 48 0 02 Feb 2020
Multilingual is not enough: BERT for Finnish Antti Virtanen Jenna Kanerva Rami Ilo Jouni Luoma Juhani Luotolahti T. Salakoski Filip Ginter S. Pyysalo 36 277 0 15 Dec 2019
Knowledge Guided Named Entity Recognition for BioMedical Text Pratyay Banerjee Kuntal Kumar Pal M. Devarakonda Chitta Baral 24 0 0 10 Nov 2019
Multi-Stage Document Ranking with BERT Rodrigo Nogueira Wei Yang Kyunghyun Cho Jimmy J. Lin 23 386 0 31 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 129 19,529 0 23 Oct 2019
Keyphrase Extraction from Scholarly Articles as Sequence Labeling using Contextualized Embeddings Dhruva Sahrawat Debanjan Mahata Mayank Kulkarni Haimin Zhang Rakesh Gosangi Amanda Stent Agniv Sharma Yaman Kumar Singla R. Shah Roger Zimmermann 11 30 0 19 Oct 2019
Biomedical relation extraction with pre-trained language representations and minimal task-specific architecture Ashok Thillaisundaram Theodosia Togia 24 17 0 26 Sep 2019
Pre-trained Language Model for Biomedical Question Answering Wonjin Yoon Jinhyuk Lee Donghyeon Kim Minbyul Jeong Jaewoo Kang AI4MH 19 85 0 18 Sep 2019
Span-based Joint Entity and Relation Extraction with Transformer Pre-training Markus Eberts A. Ulges LRM ViT 164 381 0 17 Sep 2019
Scientific Discourse Tagging for Evidence Extraction Xiangci Li Gully A. Burns Nanyun Peng 33 5 0 10 Sep 2019
Pretrained Language Models for Sequential Sentence Classification Arman Cohan Iz Beltagy Daniel King Bhavana Dalvi Daniel S. Weld 29 128 0 09 Sep 2019
Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets Yifan Peng Shankai Yan Zhiyong Lu LM&MA AI4MH 15 830 0 13 Jun 2019