SciBERT: A Pretrained Language Model for Scientific Text

26 March 2019

Kyle Lo

Arman Cohan

Papers citing "SciBERT: A Pretrained Language Model for Scientific Text"

50 / 454 papers shown

Title
Are Sample-Efficient NLP Models More Robust? Nelson F. Liu Ananya Kumar Percy Liang Robin Jia VLM OOD 30 6 0 12 Oct 2022
Readability Controllable Biomedical Document Summarization Zheheng Luo Qianqian Xie Sophia Ananiadou 45 36 0 10 Oct 2022
Spread Love Not Hate: Undermining the Importance of Hateful Pre-training for Hate Speech Detection Omkar Gokhale Aditya Kane Shantanu Patankar Tanmay Chavan Raviraj Joshi VLM 35 7 0 09 Oct 2022
Event Extraction: A Survey Viet Dac Lai 25 9 0 07 Oct 2022
Token Classification for Disambiguating Medical Abbreviations Mucahit Cevik Sanaz Jafari Mitchell Myers Savaş Yıldırım 18 0 0 05 Oct 2022
Understanding Prior Bias and Choice Paralysis in Transformer-based Language Representation Models through Four Experimental Probes Ke Shen Mayank Kejriwal 27 4 0 03 Oct 2022
YATO: Yet Another deep learning based Text analysis Open toolkit Zeqiang Wang Yile Wang Jiageng Wu Zhiyang Teng Jie Yang 40 3 0 28 Sep 2022
Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines Anmol Bansal Arjun Choudhry Anubhav Sharma Seba Susan MedIm 21 4 0 22 Sep 2022
Generalizing through Forgetting -- Domain Generalization for Symptom Event Extraction in Clinical Notes Sitong Zhou K. Lybarger Meliha Yetisgen-Yildiz Mari Ostendorf 40 2 0 20 Sep 2022
Overview of the SV-Ident 2022 Shared Task on Survey Variable Identification in Social Science Publications Tornike Tsereteli Yavuz Selim Kartal Simone Paolo Ponzetto Andrea Zielinski Kai Eckert Philipp Mayr 21 7 0 19 Sep 2022
Detecting Generated Scientific Papers using an Ensemble of Transformer Models Anna Glazkova Maksim Glazkov MedIm 38 5 0 17 Sep 2022
Prompt Combines Paraphrase: Teaching Pre-trained Models to Understand Rare Biomedical Words Hao Wang Chi-Liang Liu Nuwa Xi Sendong Zhao Meizhi Ju Shiwei Zhang Ziheng Zhang Yefeng Zheng Bing Qin Ting Liu VLM AAML LM&MA 41 6 0 14 Sep 2022
Pre-trained Language Models for the Legal Domain: A Case Study on Indian Law Shounak Paul A. Mandal Pawan Goyal Saptarshi Ghosh AILaw VLM ELM 40 45 0 13 Sep 2022
CSL: A Large-scale Chinese Scientific Literature Dataset Yudong Li Yuqing Zhang Zhe Zhao Lin-cheng Shen Weijie Liu Weiquan Mao Hui Zhang AILaw 135 50 0 12 Sep 2022
A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Language Fuchun Sun Dazhao Du Zhao-Qing Yang Yujie Zhou Jiangmeng Li Anyi Rao Haoran Sun Zhiwu Lu Ji-Rong Wen 58 108 0 12 Sep 2022
Graph Neural Networks and Representation Embedding for Table Extraction in PDF Documents Andrea Gemelli Emanuele Vivoli S. Marinai LMTD 31 11 0 23 Aug 2022
Review of Natural Language Processing in Pharmacology D. Trajanov Vangel Trajkovski Makedonka Dimitrieva Jovana Dobreva Milos Jovanovik Matej Klemen Alevs vZagar Marko Robnik-vSikonja LM&MA 36 7 0 22 Aug 2022
Transformer Encoder for Social Science Haosen Ge In Young Park Xuancheng Qian Grace Zeng 31 0 0 17 Aug 2022
FeedLens: Polymorphic Lenses for Personalizing Exploratory Search over Knowledge Graphs Harmanpreet Kaur Doug Downey Amanpreet Singh Evie (Yu-Yen) Cheng Daniel S. Weld Jonathan Bragg 37 4 0 16 Aug 2022
RadTex: Learning Efficient Radiograph Representations from Text Reports Keegan Quigley Miriam Cha Ruizhi Liao Geeticka Chauhan Steven Horng Seth Berkowitz Polina Golland MedIm 25 3 0 05 Aug 2022
A Transformer-based Neural Language Model that Synthesizes Brain Activation Maps from Free-Form Text Queries G. Ngo Minh Le Nguyen Nancy F. Chen M. Sabuncu MedIm 33 7 0 24 Jul 2022
Multi-Level Fine-Tuning, Data Augmentation, and Few-Shot Learning for Specialized Cyber Threat Intelligence Markus Bayer Tobias Frey Christian A. Reuter AAML 24 15 0 22 Jul 2022
Developing an NLP-based Recommender System for the Ethical, Legal, and Social Implications of Synthetic Biology Damien Dablain Lilian Huang Brandon Sepulvado 21 0 0 10 Jul 2022
Win-Win Cooperation: Bundling Sequence and Span Models for Named Entity Recognition Bin Ji Shasha Li Jie Yu Jun Ma Huijun Liu 27 2 0 07 Jul 2022
An Empirical Survey on Long Document Summarization: Datasets, Models and Metrics Huan Yee Koh Jiaxin Ju Ming Liu Shirui Pan 83 122 0 03 Jul 2022
Improving Low-Resource Speech Recognition with Pretrained Speech Models: Continued Pretraining vs. Semi-Supervised Training Mitchell DeHaven J. Billa VLM AI4TS 17 8 0 01 Jul 2022
GERNERMED++: Transfer Learning in German Medical NLP Johann Frei Ludwig Frei-Stuber Frank Kramer MedIm 41 8 0 29 Jun 2022
Semi-Supervised Hierarchical Graph Classification Jia Li Yongfeng Huang Heng Chang Yu Rong 31 28 0 11 Jun 2022
SsciBERT: A Pre-trained Language Model for Social Science Texts Si Shen Jiang-fu Liu Litao Lin Ying Huang Lin Zhang Changting Liu Yu Feng Dongbo Wang 11 27 0 09 Jun 2022
Augmenting Scientific Creativity with Retrieval across Knowledge Domains Hyeonsu B Kang Sheshera Mysore Kevin Huang Haw-Shiuan Chang Thorben Prein Andrew McCallum A. Kittur E. Olivetti 39 9 0 02 Jun 2022
hmBERT: Historical Multilingual Language Models for Named Entity Recognition Stefan Schweter Luisa März Katharina Schmid Erion cCano 48 18 0 31 May 2022
FinBERT-MRC: financial named entity recognition using BERT under the machine reading comprehension paradigm Yuzhe Zhang Hong Zhang 51 27 0 31 May 2022
Augmenting Scientific Creativity with an Analogical Search Engine Hyeonsu B Kang Xin-Yao Qian Tom Hope Dafna Shahaf Joel Chan A. Kittur 92 41 0 31 May 2022
K-12BERT: BERT for K-12 education Vasu Goel Dhruv Sahnan Venktesh V Gaurav Sharma Deep Dwivedi Mukesh Mohania AI4Ed 24 5 0 24 May 2022
A reproducible experimental survey on biomedical sentence similarity: a string-based method sets the state of the art Alicia Lara-Clares Juan J. Lastra-Díaz A. García-Serrano 27 0 0 18 May 2022
Miutsu: NTU's TaskBot for the Alexa Prize Yen-Ting Lin Hui-Chi Kuo Zesheng Xu Ssu Chiu Chieh-Chih Hung Yi-Cheng Chen Chao-Wei Huang Yun-Nung Chen 25 2 0 16 May 2022
ACCoRD: A Multi-Document Approach to Generating Diverse Descriptions of Scientific Concepts Sonia K. Murthy Kyle Lo Daniel King Chandra Bhagavatula Bailey Kuehl Sophie Johnson Jon Borchardt Daniel S. Weld Tom Hope Doug Downey 37 12 0 14 May 2022
PathologyBERT -- Pre-trained Vs. A New Transformer Language Model for Pathology Domain Thiago Santos Amara Tariq Susmita Das Kavyasree Vayalpati Geoffrey H. Smith Hari M. Trivedi Imon Banerjee LM&MA MedIm 17 17 0 13 May 2022
SuMe: A Dataset Towards Summarizing Biomedical Mechanisms Mohaddeseh Bastan N. Shankar Mihai Surdeanu Niranjan Balasubramanian 29 3 0 10 May 2022
CORWA: A Citation-Oriented Related Work Annotation Dataset Xiangci Li Biswadip Mandal Jessica Ouyang 33 18 0 07 May 2022
A Dataset for N-ary Relation Extraction of Drug Combinations Aryeh Tiktinsky Vijay Viswanathan Danna Niezni D. Azagury Y. Shamay Hillel Taub-Tabib Tom Hope Yoav Goldberg 37 18 0 04 May 2022
POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detection Yujian Liu Xinliang Frederick Zhang David Wegsman Nick Beauchamp Lu Wang 40 71 0 02 May 2022
Crude Oil-related Events Extraction and Processing: A Transfer Learning Approach Meisin Lee Lay-Ki Soon Eu-Gene Siew 29 0 0 01 May 2022
What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classification Elisa Bassignana Barbara Plank 23 21 0 28 Apr 2022
KALA: Knowledge-Augmented Language Model Adaptation Minki Kang Jinheon Baek Sung Ju Hwang VLM KELM 36 34 0 22 Apr 2022
Decorate the Examples: A Simple Method of Prompt Design for Biomedical Relation Extraction Hui-Syuan Yeh Thomas Lavergne Pierre Zweigenbaum 26 10 0 21 Apr 2022
A Masked Image Reconstruction Network for Document-level Relation Extraction Li Zhang Yidong Cheng 36 2 0 21 Apr 2022
Multi-label classification for biomedical literature: an overview of the BioCreative VII LitCovid Track for COVID-19 literature topic annotations Qingyu Chen Alexis Allot Robert Leaman Rezarta Islamaj Dougan Jingcheng Du ... S. Pujari Mariia Chizhikova Naveen Sivadasan Naveen Sivadasan Zhiyong Lu 27 30 0 20 Apr 2022
Synthetic Target Domain Supervision for Open Retrieval QA Revanth Reddy Gangi Reddy Bhavani Iyer Md Arafat Sultan Rong Zhang Avirup Sil Vittorio Castelli Radu Florian Salim Roukos OOD 36 12 0 20 Apr 2022
BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model Hongyi Yuan Zheng Yuan Ruyi Gan Jiaxing Zhang Yutao Xie Sheng Yu LM&MA 33 123 0 08 Apr 2022