SciBERT: A Pretrained Language Model for Scientific Text

26 March 2019

Kyle Lo

Arman Cohan

Papers citing "SciBERT: A Pretrained Language Model for Scientific Text"

50 / 452 papers shown

Title
Cross-lingual Argument Mining in the Medical Domain Anar Yeginbergenova Rodrigo Agerri 50 7 0 25 Jan 2023
An Experimental Study on Pretraining Transformers from Scratch for IR Carlos Lassance Hervé Déjean S. Clinchant 28 11 0 25 Jan 2023
AI vs. Human -- Differentiation Analysis of Scientific Content Generation Yongqiang Ma Jiawei Liu Fan Yi Qikai Cheng Yong Huang Wei Lu Xiaozhong Liu DeLMO 12 59 0 24 Jan 2023
The Semantic Scholar Open Data Platform Rodney Michael Kinney Chloe Anastasiades Russell Authur Iz Beltagy Jonathan Bragg ... Caroline M Wu Jiangjiang Yang Angele Zamarron Madeleine van Zuylen Daniel S. Weld 32 93 0 24 Jan 2023
Keyword Embeddings for Query Suggestion Jorge Gabín M. E. Ares Javier Parapar 3DV 21 2 0 19 Jan 2023
Topics in Contextualised Attention Embeddings Mozhgan Talebpour A. G. S. D. Herrera Shoaib Jameel 34 2 0 11 Jan 2023
Logic Mill -- A Knowledge Navigation System Sebastian Erhardt Mainak Ghosh Erik Buunk Michael E. Rose Dietmar Harhoff 16 2 0 31 Dec 2022
TA-DA: Topic-Aware Domain Adaptation for Scientific Keyphrase Identification and Classification (Student Abstract) Razvan-Alexandru Smadu George-Eduard Zaharia Andrei-Marius Avram Dumitru-Clementin Cercel M. Dascalu Florin-Catalin Pop BDL 29 1 0 30 Dec 2022
Sequence Generation with Label Augmentation for Relation Extraction Bo Li Dingyao Yu Wei Ye Jinglei Zhang Shikun Zhang VLM 39 18 0 29 Dec 2022
Automatic Recognition and Classification of Future Work Sentences from Academic Articles in a Specific Domain Chengzhi Zhang Yi Xiang Wenke Hao Zhicheng Li Yuchen Qian Yuzhuo Wang 18 11 0 28 Dec 2022
Explainable AI for Bioinformatics: Methods, Tools, and Applications Md. Rezaul Karim Tanhim Islam Oya Beyan Christoph Lange Michael Cochez Dietrich-Rebholz Schuhmann Stefan Decker 31 68 0 25 Dec 2022
Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editing Shengchao Liu Weili Nie Chengpeng Wang Jiarui Lu Zhuoran Qiao Ling Liu Jian Tang Chaowei Xiao Anima Anandkumar 48 153 0 21 Dec 2022
Multilingual Sequence-to-Sequence Models for Hebrew NLP Matan Eyal Hila Noga Roee Aharoni Idan Szpektor Reut Tsarfaty 36 4 0 19 Dec 2022
Words as Gatekeepers: Measuring Discipline-specific Terms and Meanings in Scholarly Publications L. Lucy Jesse Dodge David Bamman Katherine A. Keith 39 9 0 19 Dec 2022
The Effects of In-domain Corpus Size on pre-training BERT Chris Sanchez Zheyu Zhang AI4CE 16 4 0 15 Dec 2022
MORTY: Structured Summarization for Targeted Information Extraction from Scholarly Articles M. Y. Jaradeh M. Stocker Sören Auer 38 1 0 11 Dec 2022
MOPRD: A multidisciplinary open peer review dataset Jialiang Lin Jiaxin Song Zhangping Zhou Yidong Chen X. Shi 33 12 0 09 Dec 2022
Scientific Paper Extractive Summarization Enhanced by Citation Graphs Preslav Nakov Mingzhe Li Shen Gao Rui Yan Xin Gao Xiangliang Zhang 25 12 0 08 Dec 2022
G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks Zhongwei Wan Yichun Yin Wei Zhang Jiaxin Shi Lifeng Shang Guangyong Chen Xin Jiang Qun Liu VLM CLL 36 16 0 07 Dec 2022
CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domain Markus Bayer Philip D. . Kuehn Ramin Shanehsaz Christian A. Reuter 15 43 0 06 Dec 2022
Intent Recognition in Conversational Recommender Systems Sahar Moradizeyveh 45 5 0 06 Dec 2022
BudgetLongformer: Can we Cheaply Pretrain a SotA Legal Language Model From Scratch? Joel Niklaus Daniele Giofré 33 11 0 30 Nov 2022
Using Selective Masking as a Bridge between Pre-training and Fine-tuning Tanish Lad Himanshu Maheshwari Shreyas Kottukkal R. Mamidi 24 3 0 24 Nov 2022
SciRepEval: A Multi-Format Benchmark for Scientific Document Representations Amanpreet Singh Mike DÁrcy Arman Cohan Doug Downey Sergey Feldman 29 82 0 23 Nov 2022
Evaluating the Knowledge Dependency of Questions Hyeongdon Moon Yoonseok Yang Jamin Shin Hangyeol Yu Seunghyun Lee Myeongho Jeong Juneyoung Park Minsam Kim Seungtaek Choi AI4Ed 31 10 0 21 Nov 2022
Controllable Citation Sentence Generation with Language Models Nianlong Gu Richard H. R. Hahnloser 33 2 0 14 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 28 124 0 11 Nov 2022
Combating Health Misinformation in Social Media: Characterization, Detection, Intervention, and Open Issues Canyu Chen Haoran Wang Matthew A. Shapiro Yunyu Xiao Fei Wang Kai Shu 27 12 0 10 Nov 2022
Combining Contrastive Learning and Knowledge Graph Embeddings to develop medical word embeddings for the Italian language Denys Amore Bondarenko Roger Ferrod Luigi Di Caro 21 1 0 09 Nov 2022
Unsupervised Domain Adaptation for Sparse Retrieval by Filling Vocabulary and Word Frequency Gaps Hiroki Iida Naoaki Okazaki 42 4 0 08 Nov 2022
Hierarchical Multi-Label Classification of Scientific Documents Mobashir Sadat Cornelia Caragea 19 18 0 05 Nov 2022
SMAuC -- The Scientific Multi-Authorship Corpus Janek Bevendorff Philipp Sauer Lukas Gienapp Wolfgang Kircheis Erik Korner Benno Stein Martin Potthast 27 0 0 04 Nov 2022
CCS Explorer: Relevance Prediction, Extractive Summarization, and Named Entity Recognition from Clinical Cohort Studies Irfan Al-Hussaini D. An Albert Lee Sarah Bi Cassie S. Mitchell 11 7 0 01 Nov 2022
WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domain Raj Sanjay Shah Kunal Chawla Dheeraj Eidnani Agam Shah Wendi Du Sudheer Chava Natraj Raman Charese Smiley Jiaao Chen Diyi Yang AIFin 37 103 0 31 Oct 2022
How Far are We from Robust Long Abstractive Summarization? Huan Yee Koh Jiaxin Ju He Zhang Ming Liu Shirui Pan HILM 33 39 0 30 Oct 2022
Leveraging knowledge graphs to update scientific word embeddings using latent semantic imputation J. Hoelscher-Obermaier Edward Stevinson V. Stauber Ivaylo Zhelev Victor Botev R. Wu J. Minton 19 0 0 27 Oct 2022
Towards Language-driven Scientific AI José Manuél Gómez-Pérez 34 0 0 27 Oct 2022
arXivEdits: Understanding the Human Revision Process in Scientific Writing Chao Jiang Wei Xu Samuel Stevens 30 22 0 26 Oct 2022
Uncertainty Sentence Sampling by Virtual Adversarial Perturbation Han Zhang Zhen Zhang Hongfei Jiang Yang Song 28 0 0 26 Oct 2022
ReSel: N-ary Relation Extraction from Scientific Text and Tables by Learning to Retrieve and Select Yuchen Zhuang Yinghao Li Jerry Junyang Cheung Yue Yu Yingjun Mou Xinyu Chen Le Song Chao Zhang 29 19 0 26 Oct 2022
Automatic extraction of materials and properties from superconductors scientific literature Luca Foppiano P. B. Castro Pedro Ortiz Suarez K. Terashima Y. Takano Masashi Ishii 38 12 0 26 Oct 2022
PcMSP: A Dataset for Scientific Action Graphs Extraction from Polycrystalline Materials Synthesis Procedure Text Xianjun Yang Ya Zhuo Julia Zuo Xinlu Zhang Stephen D. Wilson Linda R. Petzold 34 11 0 22 Oct 2022
Rescue Implicit and Long-tail Cases: Nearest Neighbor Relation Extraction Zhen Wan Qianying Liu Zhuoyuan Mao Fei Cheng Sadao Kurohashi Jiwei Li 35 8 0 21 Oct 2022
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining Renqian Luo Liai Sun Yingce Xia Tao Qin Sheng Zhang Hoifung Poon Tie-Yan Liu MedIm AI4CE LM&MA 62 790 0 19 Oct 2022
Making Science Simple: Corpora for the Lay Summarisation of Scientific Literature Tomas Goldsack Zhihao Zhang Chenghua Lin Carolina Scarton 32 74 0 18 Oct 2022
Transfer learning with affine model transformation Shunya Minami Kenji Fukumizu Yoshihiro Hayashi Ryo Yoshida 27 1 0 18 Oct 2022
Can Language Representation Models Think in Bets? Zhi–Bin Tang Mayank Kejriwal 15 6 0 14 Oct 2022
MTEB: Massive Text Embedding Benchmark Niklas Muennighoff Nouamane Tazi L. Magne Nils Reimers 30 374 0 13 Oct 2022
Developing a general-purpose clinical language inference model from a large corpus of clinical notes Madhumita Sushil Dana Ludwig A. Butte V. Rudrapatna LM&MA 14 12 0 12 Oct 2022
Are Sample-Efficient NLP Models More Robust? Nelson F. Liu Ananya Kumar Percy Liang Robin Jia VLM OOD 30 6 0 12 Oct 2022