SciBERT: A Pretrained Language Model for Scientific Text

26 March 2019

Kyle Lo

Arman Cohan

Papers citing "SciBERT: A Pretrained Language Model for Scientific Text"

50 / 454 papers shown

Title
Coreference Resolution for the Biomedical Domain: A Survey Pengcheng Lu Massimo Poesio 34 15 0 25 Sep 2021
SAIS: Supervising and Augmenting Intermediate Steps for Document-Level Relation Extraction Yuxin Xiao Zecheng Zhang Yuning Mao Carl Yang Jiawei Han RALM AI4TS 24 47 0 24 Sep 2021
Separating Retention from Extraction in the Evaluation of End-to-end Relation Extraction Bruno Taillé Vincent Guigue Geoffrey Scoutheeten Patrick Gallinari 79 5 0 24 Sep 2021
A Study of the Generalizability of Self-Supervised Representations Atharva Tendle Mohammad Rashedul Hasan 78 27 0 19 Sep 2021
Spanish Biomedical Crawled Corpus: A Large, Diverse Dataset for Spanish Biomedical Language Models C. Carrino Jordi Armengol-Estapé Ona de Gibert Bonet Asier Gutiérrez-Fandiño Aitor Gonzalez-Agirre Martin Krallinger Marta Villegas 24 20 0 16 Sep 2021
Can Language Models be Biomedical Knowledge Bases? Mujeen Sung Jinhyuk Lee Sean S. Yi Minji Jeon Sungdong Kim Jaewoo Kang AI4MH 128 105 0 15 Sep 2021
Learning Bill Similarity with Annotated and Augmented Corpora of Bills Jiseon Kim Elden Griggs In Song Kim Alice Oh AILaw 20 5 0 14 Sep 2021
Packed Levitated Marker for Entity and Relation Extraction Deming Ye Yankai Lin Peng Li Maosong Sun 141 106 0 13 Sep 2021
Question Answering over Electronic Devices: A New Benchmark Dataset and a Multi-Task Learning based QA Framework Abhilash Nandy Soumya Sharma Shubham Maddhashiya K. Sachdeva Pawan Goyal Niloy Ganguly 30 17 0 13 Sep 2021
Document-level Entity-based Extraction as Template Generation Kung-Hsiang Huang Sam Tang Nanyun Peng 22 54 0 10 Sep 2021
Learning to Teach with Student Feedback Yitao Liu Tianxiang Sun Xipeng Qiu Xuanjing Huang VLM 23 6 0 10 Sep 2021
Biomedical and Clinical Language Models for Spanish: On the Benefits of Domain-Specific Pretraining in a Mid-Resource Scenario C. Carrino Jordi Armengol-Estapé Asier Gutiérrez-Fandiño Joan Llop-Palao Marc Pàmies Aitor Gonzalez-Agirre Marta Villegas 16 44 0 08 Sep 2021
GPT-3 Models are Poor Few-Shot Learners in the Biomedical Domain M. Moradi Kathrin Blagec F. Haberl Matthias Samwald LM&MA AI4MH 42 65 0 06 Sep 2021
Sent2Span: Span Detection for PICO Extraction in the Biomedical Text without Span Annotations Shifeng Liu Yifang Sun Bing Li Wei Wang Florence T. Bourgeois A. Dunn 19 14 0 06 Sep 2021
Self-Supervised Detection of Contextual Synonyms in a Multi-Class Setting: Phenotype Annotation Use Case Jingqing Zhang Luis Bolaños T. Li Ashwani Tanwar Guilherme Freire Xian Yang Julia Ive Vibhor Gupta Yike Guo 21 14 0 04 Sep 2021
LegaLMFiT: Efficient Short Legal Text Classification with LSTM Language Model Pre-Training Benjamin Clavié Akshita Gheewala Paul Briton Marc Alphonsus Rym Labiyaad Francesco Piccoli VLM AILaw 32 2 0 02 Sep 2021
Pattern-based Acquisition of Scientific Entities from Scholarly Article Titles Jennifer D'Souza Soeren Auer 30 11 0 01 Sep 2021
Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Salience G. Chrysostomou Nikolaos Aletras 32 16 0 31 Aug 2021
Automated Mining of Leaderboards for Empirical AI Research Salomon Kabongo KABENAMUALU Jennifer D'Souza Sören Auer 41 29 0 31 Aug 2021
Fine-Grained Chemical Entity Typing with Multimodal Knowledge Representation Chenkai Sun Weijian Li Jinfeng Xiao Nikolaus Nova Parulian ChengXiang Zhai Heng Ji 44 4 0 29 Aug 2021
A Partition Filter Network for Joint Entity and Relation Extraction Zhiheng Yan Chong Zhang Jinlan Fu Qi Zhang Zhongyu Wei 28 135 0 27 Aug 2021
Data Augmentation for Low-Resource Named Entity Recognition Using Backtranslation Usama Yaseen Stefan Langer MedIm 21 15 0 26 Aug 2021
Extracting Qualitative Causal Structure with Transformer-Based NLP Scott E. Friedman Ian H. Magnusson Sonja M. Schmer-Galunder NAI 20 5 0 20 Aug 2021
SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining Taolin Zhang Zerui Cai Chengyu Wang Minghui Qiu Bite Yang Xiaofeng He AI4MH 28 52 0 20 Aug 2021
ACM-CR: A Manually Annotated Test Collection for Citation Recommendation Florian Boudin HAI MLAU 21 0 0 17 Aug 2021
Extracting Semantics from Maintenance Records Sharad Dixit Varish Mulwad A. Saxena 24 3 0 11 Aug 2021
COMPARE: A Taxonomy and Dataset of Comparison Discussions in Peer Reviews Shruti Singh M. Singh Pawan Goyal 27 8 0 09 Aug 2021
VitaLITy: Promoting Serendipitous Discovery of Academic Literature with Transformers & Visual Analytics Arpit Narechania Alireza Karduni Ryan Wesslen Emily Wall 54 25 0 07 Aug 2021
Automatic Detection of COVID-19 Vaccine Misinformation with Graph Link Prediction Maxwell Weinzierl S. Harabagiu 14 29 0 04 Aug 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 79 3,853 0 28 Jul 2021
Back-Translated Task Adaptive Pretraining: Improving Accuracy and Robustness on Text Classification Junghoon Lee Jounghee Kim Pilsung Kang VLM 19 5 0 22 Jul 2021
Overview and Insights from the SciVer Shared Task on Scientific Claim Verification David Wadden Kyle Lo 69 11 0 17 Jul 2021
MOOCRep: A Unified Pre-trained Embedding of MOOC Entities Shalini Pandey Jaideep Srivastava 19 0 0 12 Jul 2021
Benchmarking for Biomedical Natural Language Processing Tasks with a Domain Specific ALBERT Usman Naseem A. Dunn Matloob Khushi Jinman Kim OOD LM&MA AI4MH 24 43 0 09 Jul 2021
UniRE: A Unified Label Space for Entity Relation Extraction Yijun Wang Changzhi Sun Yuanbin Wu Hao Zhou Lei Li Junchi Yan 22 112 0 09 Jul 2021
Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Review Irene Z Li Jessica Pan Jeremy Goldwasser Neha Verma Wai Pan Wong ... Matthew Zhang David Chang R. Taylor H. Krumholz Dragomir R. Radev BDL 26 154 0 07 Jul 2021
Weakly Supervised Named Entity Tagging with Learnable Logical Rules Jiacheng Li Haibo Ding Jingbo Shang Julian McAuley Zhe Feng NAI 27 37 0 05 Jul 2021
Language Identification of Hindi-English tweets using code-mixed BERT M. Z. Ansari M. Beg Tanvir Ahmad Mohd Jazib Khan Ghazali Wasim 45 14 0 02 Jul 2021
A Span-Based Model for Joint Overlapped and Discontinuous Named Entity Recognition Fei Li Zhichao Lin Meishan Zhang Donghong Ji 24 92 0 28 Jun 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature Yu-Chiang Frank Wang Jinchao Li Tristan Naumann Chenyan Xiong Hao Cheng ... Yang Qin Eric Horvitz Paul N. Bennett Jianfeng Gao Hoifung Poon OOD 33 13 0 25 Jun 2021
Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study Rahul Nadkarni David Wadden Iz Beltagy Noah A. Smith Hannaneh Hajishirzi Tom Hope 40 27 0 17 Jun 2021
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark Ningyu Zhang Mosha Chen Zhen Bi Xiaozhuan Liang Lei Li ... Jun Yan Hongying Zan Kunli Zhang Buzhou Tang Qingcai Chen LM&MA ELM 34 179 0 15 Jun 2021
Probing Pre-Trained Language Models for Disease Knowledge Israa Alghanmi Luis Espinosa-Anke Steven Schockaert LM&MA ELM 33 13 0 14 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 58 818 0 14 Jun 2021
Correcting Exposure Bias for Link Recommendation Shantanu Gupta Hao Wang Zachary Chase Lipton Bernie Wang CML 34 34 0 13 Jun 2021
EPICURE Ensemble Pretrained Models for Extracting Cancer Mutations from Literature Jiarun Cao E. M. Veen Niels Peek A. Renehan Sophia Ananiadou 8 11 0 11 Jun 2021
Linguistically Informed Masking for Representation Learning in the Patent Domain Sophia Althammer Mark Buckley Sebastian Hofstatter Allan Hanbury 45 11 0 10 Jun 2021
SemEval-2021 Task 11: NLPContributionGraph -- Structuring Scholarly NLP Contributions for a Research Knowledge Graph Jennifer D'Souza Sören Auer Ted Pedersen 46 30 0 10 Jun 2021
Document-level Relation Extraction as Semantic Segmentation Ningyu Zhang Xiang Chen Xin Xie Shumin Deng Chuanqi Tan Mosha Chen Fei Huang Luo Si Huajun Chen ViT 22 182 0 07 Jun 2021
Enhancing Taxonomy Completion with Concept Generation via Fusing Relational Representations Qingkai Zeng Jinfeng Lin Wenhao Yu J. Cleland-Huang Meng Jiang 19 43 0 05 Jun 2021