SciBERT: A Pretrained Language Model for Scientific Text

26 March 2019

Kyle Lo

Arman Cohan

Papers citing "SciBERT: A Pretrained Language Model for Scientific Text"

50 / 452 papers shown

Title
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models Memories Shizhe Diao Tianyang Xu Ruijia Xu Jiawei Wang Tong Zhang MoE AI4CE 13 36 0 08 Jun 2023
Extensive Evaluation of Transformer-based Architectures for Adverse Drug Events Extraction Simone Scaboro Beatrice Portelli Emmanuele Chersoni Enrico Santus Giuseppe Serra 24 8 0 08 Jun 2023
Good Data, Large Data, or No Data? Comparing Three Approaches in Developing Research Aspect Classifiers for Biomedical Papers S. Chandrasekhar Huang Chieh-Yang Ting-Hao 'Kenneth' Huang 32 2 0 07 Jun 2023
Leveraging Knowledge Graph Embeddings to Enhance Contextual Representations for Relation Extraction F. Laleye Loïc Rakotoson S. Massip 18 1 0 07 Jun 2023
SciLit: A Platform for Joint Scientific Literature Discovery, Summarization and Citation Generation Nianlong Gu Richard H. R. Hahnloser 69 5 0 06 Jun 2023
Jointprop: Joint Semi-supervised Learning for Entity and Relation Extraction with Heterogeneous Graph-based Propagation Yandan Zheng Anran Hao A. Luu 21 8 0 25 May 2023
SciReviewGen: A Large-scale Dataset for Automatic Literature Review Generation Tetsu Kasanishi Masaru Isonuma Junichiro Mori Ichiro Sakata 18 8 0 24 May 2023
Difference-Masking: Choosing What to Mask in Continued Pretraining Alex Wilf Syeda Nahida Akter Leena Mathur Paul Pu Liang Sheryl Mathew Mengrou Shou Eric Nyberg Louis-Philippe Morency CLL SSL 32 4 0 23 May 2023
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding Yu Zhang Hao Cheng Zhihong Shen Xiaodong Liu Yejiang Wang Jianfeng Gao 32 14 0 23 May 2023
Rethinking Semi-supervised Learning with Language Models Zhengxiang Shi Francesco Tonolini Nikolaos Aletras Emine Yilmaz G. Kazai Yunlong Jiao 34 18 0 22 May 2023
Evaluating Prompt-based Question Answering for Object Prediction in the Open Research Knowledge Graph Jennifer D'Souza Moussab Hrou Sören Auer 24 2 0 22 May 2023
Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model Xiao Wang Wei Zhou Qi Zhang Jie Zhou Songyang Gao Junzhe Wang Menghan Zhang Xiang Gao Yunwen Chen Tao Gui 48 7 0 22 May 2023
TADA: Efficient Task-Agnostic Domain Adaptation for Transformers Chia-Chien Hung Lukas Lange Jannik Strötgen 30 9 0 22 May 2023
Patton: Language Model Pretraining on Text-Rich Networks Bowen Jin Wentao Zhang Yu Zhang Yu Meng Xinyang Zhang Qi Zhu Jiawei Han VLM 48 45 0 20 May 2023
Appraising the Potential Uses and Harms of LLMs for Medical Systematic Reviews Hye Sun Yun Iain J. Marshall T. Trikalinos Byron C. Wallace 26 17 0 19 May 2023
Brain-inspired learning in artificial neural networks: a review Samuel Schmidgall Jascha Achterberg Thomas Miconi Louis Kirsch Rojin Ziaei S. P. Hajiseyedrazi Jason K. Eshraghian 38 52 0 18 May 2023
MolXPT: Wrapping Molecules with Text for Generative Pre-training Zequn Liu Wei Zhang Yingce Xia Lijun Wu Shufang Xie Tao Qin M. Zhang Tie-Yan Liu 34 67 0 18 May 2023
Semantic Similarity Measure of Natural Language Text through Machine Learning and a Keyword-Aware Cross-Encoder-Ranking Summarizer -- A Case Study Using UCGIS GIS&T Body of Knowledge Yuanyuan Tian Wenwen Li Sizhe Wang Zhining Gu 24 3 0 17 May 2023
A Hierarchical Encoding-Decoding Scheme for Abstractive Multi-document Summarization Chenhui Shen Liying Cheng Xuan-Phi Nguyen Yang You Lidong Bing 30 10 0 15 May 2023
MatSci-NLP: Evaluating Scientific Language Models on Materials Science Language Tasks Using Text-to-Schema Modeling Yurun Song Santiago Miret Bang Liu 33 30 0 14 May 2023
Going beyond research datasets: Novel intent discovery in the industry setting Aleksandra Chrabrowa Tsimur Hadeliya D. Kajtoch Robert Mroczkowski Piotr Rybak 24 2 0 09 May 2023
GersteinLab at MEDIQA-Chat 2023: Clinical Note Summarization from Doctor-Patient Conversations through Fine-tuning and In-context Learning Xiangru Tang Andrew Tran Jeffrey Tan Mark B. Gerstein 29 7 0 08 May 2023
Evaluating BERT-based Scientific Relation Classifiers for Scholarly Knowledge Graph Construction on Digital Library Collections Ming Jiang Jennifer D'Souza Sören Auer J. S. Downie 24 7 0 03 May 2023
BactInt: A domain driven transfer learning approach and a corpus for extracting inter-bacterial interactions from biomedical text K. D. Baksi Vatsala Pokhrel Bhusan K. Kuntal S. Mande 21 0 0 27 Apr 2023
Neural Keyphrase Generation: Analysis and Evaluation Tuhin Kundu Jishnu Ray Chowdhury Cornelia Caragea 31 0 0 27 Apr 2023
Towards Medical Artificial General Intelligence via Knowledge-Enhanced Multimodal Pretraining Bingqian Lin Zicong Chen Mingjie Li Haokun Lin Hang Xu ... Ling-Hao Chen Xiaojun Chang Yi Yang L. Xing Xiaodan Liang LM&MA MedIm AI4CE 40 14 0 26 Apr 2023
Generating Topic Pages for Scientific Concepts Using Scientific Publications H. Azarbonyad Z. Afzal G. Tsatsaronis 28 2 0 24 Apr 2023
Computational modeling of semantic change Nina Tahmasebi Haim Dubossarsky 38 6 0 13 Apr 2023
End-to-End Models for Chemical-Protein Interaction Extraction: Better Tokenization and Span-Based Pipeline Strategies Xu-Xia Ai Ramakanth Kavuluru 27 5 0 03 Apr 2023
DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains Yanis Labrak Adrien Bazoge Richard Dufour Mickael Rouvier Emmanuel Morin B. Daille P. Gourraud LM&MA 25 54 0 03 Apr 2023
Enhancing Clinical Evidence Recommendation with Multi-Channel Heterogeneous Learning on Evidence Graphs Maolin Luo Xiang Zhang 19 0 0 03 Apr 2023
BloombergGPT: A Large Language Model for Finance Shijie Wu Ozan Irsoy Steven Lu Vadim Dabravolski Mark Dredze Sebastian Gehrmann P. Kambadur David S. Rosenberg Gideon Mann AIFin 99 793 0 30 Mar 2023
Carolina: a General Corpus of Contemporary Brazilian Portuguese with Provenance, Typology and Versioning Information MariaJose Crespo Maria Lina Rocha Mariana Sturzeneker F. Serras Guilherme Lamartine de Mello ... Mariana M. Silva Marcelo Finger Maria Clara Paixão de Sousa Cristiane Namiuti Vanessa Martins do Monte 14 3 0 28 Mar 2023
The Semantic Reader Project: Augmenting Scholarly Documents through AI-Powered Interactive Reading Interfaces Kyle Lo Joseph Chee Chang Andrew Head Jonathan Bragg Amy X. Zhang ... Caroline M Wu Jiangjiang Yang Angele Zamarron Marti A. Hearst Daniel S. Weld 34 19 0 25 Mar 2023
Lay Text Summarisation Using Natural Language Processing: A Narrative Literature Review Oliver Vinzelberg M. Jenkins Gordon Morison David McMinn Z. Tieges 37 6 0 24 Mar 2023
A Gold Standard Dataset for the Reviewer Assignment Problem Ivan Stelmakh John Wieting Graham Neubig Nihar B. Shah 39 15 0 23 Mar 2023
ChatGPT for Shaping the Future of Dentistry: The Potential of Multi-Modal Large Language Model Hanyao Huang Ou Zheng Dongdong Wang Jiayi Yin Zijin Wang ... H. Yin Chuan Xu Renjie Yang Q. Zheng B. Shi MedIm AI4MH AI4CE LM&MA 58 176 0 23 Mar 2023
JaCoText: A Pretrained Model for Java Code-Text Generation Jessica Nayeli López Espejel Mahaman Sanoussi Yahaya Alassan Walid Dahhane E. Ettifouri 37 3 0 22 Mar 2023
NASA Science Mission Directorate Knowledge Graph Discovery Roelien C. Timmer F. S. Khoo Megan Mark Marcella Scoczynski Ribeiro Martins A. Berea Gregory Renard K. Bugbee 24 1 0 20 Mar 2023
Applying unsupervised keyphrase methods on concepts extracted from discharge sheets Hoda Memarzadeh Nasser Ghadiri Matthias Samwald Maryam Lotfi Shahreza 44 0 0 15 Mar 2023
Inline Citation Classification using Peripheral Context and Time-evolving Augmentation Priyanshi Gupta Yash Kumar Atri Apurva Nagvenkar Sourish Dasgupta Tanmoy Chakraborty 24 2 0 01 Mar 2023
IGB: Addressing The Gaps In Labeling, Features, Heterogeneity, and Size of Public Graph Datasets for Deep Learning Research Arpandeep Khatua Vikram Sharma Mailthody Bhagyashree Taleka Tengfei Ma Xiang Song Wen-mei W. Hwu AI4CE 48 38 0 27 Feb 2023
Summaries as Captions: Generating Figure Captions for Scientific Documents with Automated Text Summarization Huang Chieh-Yang Ting-Yao Hsu Ryan A. Rossi A. Nenkova Sungchul Kim G. Chan Eunyee Koh C. Lee Giles Ting-Hao 'Kenneth' Huang 22 16 0 23 Feb 2023
A Biomedical Knowledge Graph for Biomarker Discovery in Cancer Md. Rezaul Karim Lina Molinas Comet Oya Beyan Dietrich-Rebholz Schuhmann Stefan Decker 22 2 0 09 Feb 2023
Lightweight Transformers for Clinical Natural Language Processing Omid Rohanian Mohammadmahdi Nouriborji Hannah Jauncey Samaneh Kouchaki Isaric Clinical Characterisation Group Lei A. Clifton L. Merson David Clifton MedIm LM&MA 29 12 0 09 Feb 2023
Zero-Shot Learning for Requirements Classification: An Exploratory Study Waad Alhoshan Alessio Ferrari Liping Zhao VLM 17 39 0 09 Feb 2023
A Text-guided Protein Design Framework Shengchao Liu Yanjing Li Zhuoxinran Li A. Gitter Yutao Zhu ... Arvind Ramanathan Chaowei Xiao Jian Tang Hongyu Guo Anima Anandkumar 70 61 0 09 Feb 2023
GLADIS: A General and Large Acronym Disambiguation Benchmark Lihu Chen Gaël Varoquaux Fabian M. Suchanek ELM 34 4 0 03 Feb 2023
ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Texts Minghao Xu Xinyu Yuan Santiago Miret Jian Tang AI4TS 32 95 0 28 Jan 2023
Context Matters: A Strategy to Pre-train Language Model for Science Education Zhengliang Liu Xinyue He Lei Liu Tianming Liu Xiaoming Zhai 14 40 0 27 Jan 2023