LinkBERT: Pretraining Language Models with Document Links

29 March 2022

Papers citing "LinkBERT: Pretraining Language Models with Document Links"

50 / 164 papers shown

Title
Developing Healthcare Language Model Embedding Spaces Niall Taylor Dan Schofield Andrey Kormilitzin Dan W Joyce A. Nevado-Holgado 35 0 0 28 Mar 2024
BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Text Elliot Bolton Abhinav Venigalla Michihiro Yasunaga David Leo Wright Hall Betty Xiong ... R. Daneshjou Jonathan Frankle Percy Liang Michael Carbin Christopher D. Manning LM&MA MedIm 32 51 0 27 Mar 2024
AI for Biomedicine in the Era of Large Language Models Zhenyu Bi Sajib Acharjee Dip Daniel Hajialigol Sindhura Kommu Hanwen Liu Meng Lu Xuan Wang LM&MA AI4CE 28 8 0 23 Mar 2024
KG-TREAT: Pre-training for Treatment Effect Estimation by Synergizing Patient Data with Knowledge Graphs Ruoqi Liu Lingfei Wu Ping Zhang 16 1 0 06 Mar 2024
Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Survey Qizhi Pei Lijun Wu Kaiyuan Gao Jinhua Zhu Yue Wang Zun Wang Tao Qin Rui Yan AI4CE 51 19 0 03 Mar 2024
MediSwift: Efficient Sparse Pre-trained Biomedical Language Models Vithursan Thangarasa Mahmoud Salem Shreyas Saxena Kevin Leong Joel Hestness Sean Lie MedIm 32 1 0 01 Mar 2024
JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering Capability Junda Wang Zhichao Yang Zonghai Yao Hong-ye Yu BDL AI4MH LRM 40 30 0 27 Feb 2024
BiMediX: Bilingual Medical Mixture of Experts LLM Sara Pieri Sahal Shaji Mullappilly Fahad Shahbaz Khan Rao Muhammad Anwer Salman Khan Timothy Baldwin Hisham Cholakkal LM&MA 43 12 0 20 Feb 2024
Effective and Efficient Conversation Retrieval for Dialogue State Tracking with Implicit Text Summaries Seanie Lee Jianpeng Cheng Joris Driesen Alexandru Coca Anders Johannsen RALM 40 1 0 20 Feb 2024
HunFlair2 in a cross-corpus evaluation of biomedical named entity recognition and normalization tools Mario Sanger Samuele Garda Xing David Wang Leon Weber-Genzel Pia Droop Benedikt Fuchs Alan Akbik Ulf Leser 35 6 0 19 Feb 2024
SemPool: Simple, robust, and interpretable KG pooling for enhancing language models Costas Mavromatis Petros Karypis George Karypis KELM RALM 47 2 0 03 Feb 2024
MolTailor: Tailoring Chemical Molecular Representation to Specific Tasks via Text Prompts Haoqiang Guo Sendong Zhao Hao Wang Yanrui Du Bing Qin AI4CE 21 8 0 21 Jan 2024
Developing ChatGPT for Biology and Medicine: A Complete Review of Biomedical Question Answering Qing Li Lei Li Yu Li LM&MA AI4MH 41 6 0 15 Jan 2024
EpilepsyLLM: Domain-Specific Large Language Model Fine-tuned with Epilepsy Medical Knowledge Xuyang Zhao Qibin Zhao Toshihisa Tanaka AI4MH 22 1 0 11 Jan 2024
Data-Centric Foundation Models in Computational Healthcare: A Survey Yunkun Zhang Jin Gao Zheling Tan Lingfeng Zhou Kexin Ding Mu Zhou Shaoting Zhang Dequan Wang AI4CE 37 22 0 04 Jan 2024
Diversifying Knowledge Enhancement of Biomedical Language Models using Adapter Modules and Knowledge Graphs Juraj Vladika Alexander Fichtl Florian Matthes KELM 22 1 0 21 Dec 2023
Wikiformer: Pre-training with Structured Information of Wikipedia for Ad-hoc Retrieval Weihang Su Qingyao Ai Xiangsheng Li Jia Chen Yiqun Liu Xiaolong Wu Shengluan Hou 16 13 0 17 Dec 2023
BESTMVQA: A Benchmark Evaluation System for Medical Visual Question Answering Xiaojie Hong Zixin Song Liangzhi Li Xiaoli Wang Feiyan Liu 22 1 0 13 Dec 2023
Large Language Models on Graphs: A Comprehensive Survey Bowen Jin Gang Liu Chi Han Meng Jiang Heng Ji Jiawei Han AI4CE 31 138 0 05 Dec 2023
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine Harsha Nori Yin Tat Lee Sheng Zhang Dean Carignan Richard Edgar ... Hoifung Poon Tao Qin Naoto Usuyama Chris White Eric Horvitz LM&MA AI4MH MedIm ELM 30 294 0 28 Nov 2023
nach0: Multimodal Natural and Chemical Languages Foundation Model M. Livne Z. Miftahutdinov E. Tutubalina Maksim Kuznetsov Daniil Polykovskiy ... Aastha Jhunjhunwala Anthony Costa Alex Aliper Alán Aspuru-Guzik Alex Zhavoronkov AI4CE 27 12 0 21 Nov 2023
Segment Together: A Versatile Paradigm for Semi-Supervised Medical Image Segmentation Qingjie Zeng Yutong Xie Zilin Lu Mengkang Lu Yicheng Wu Yong-quan Xia 31 3 0 20 Nov 2023
KBioXLM: A Knowledge-anchored Biomedical Multilingual Pretrained Language Model Lei Geng Xu Yan Ziqiang Cao Juntao Li Wenjie Li Sujian Li Xinjie Zhou Yang Yang Jun Zhang 30 0 0 20 Nov 2023
A Survey of Large Language Models in Medicine: Progress, Application, and Challenge Hongjian Zhou Fenglin Liu Boyang Gu Xinyu Zou Jinfa Huang ... Yefeng Zheng Lei A. Clifton Zheng Li Fenglin Liu David A. Clifton LM&MA 33 107 0 09 Nov 2023
GRENADE: Graph-Centric Language Model for Self-Supervised Representation Learning on Text-Attributed Graphs Yichuan Li Kaize Ding Kyumin Lee SSL 20 24 0 23 Oct 2023
Pretraining Language Models with Text-Attributed Heterogeneous Graphs Tao Zou Le Yu Yifei Huang Leilei Sun Bo Du AI4CE 17 17 0 19 Oct 2023
In-context Pretraining: Language Modeling Beyond Document Boundaries Weijia Shi Sewon Min Maria Lomeli Chunting Zhou Margaret Li ... Victoria Lin Noah A. Smith Luke Zettlemoyer Scott Yih Mike Lewis LRM RALM SyDa 32 48 0 16 Oct 2023
Emerging Challenges in Personalized Medicine: Assessing Demographic Effects on Biomedical Question Answering Systems Sagi Shaier Kevin Bennett Lawrence E Hunter K. Wense 29 0 0 16 Oct 2023
On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language Models Thilini Wijesiriwardene Ruwan Wickramarachchi Aishwarya N. Reganti Vinija Jain Aman Chadha Amit P. Sheth Amitava Das 16 1 0 11 Oct 2023
Large Language Models as Analogical Reasoners Michihiro Yasunaga Xinyun Chen Yujia Li Panupong Pasupat J. Leskovec Percy Liang Ed H. Chi Denny Zhou ReLM LRM 21 77 0 03 Oct 2023
Generating Explanations in Medical Question-Answering by Expectation Maximization Inference over Evidence Wei Sun Mingxiao Li Damien Sileo Jesse Davis Marie-Francine Moens MedIm 11 0 0 02 Oct 2023
EALM: Introducing Multidimensional Ethical Alignment in Conversational Information Retrieval Yiyao Yu Junjie Wang Yuxiang Zhang Lin Zhang Yujiu Yang Tetsuya Sakai 35 1 0 02 Oct 2023
Graph Neural Prompting with Large Language Models Yijun Tian Huan Song Zichen Wang Haozhu Wang Ziqing Hu Fang Wang Nitesh V. Chawla Panpan Xu AI4CE 37 44 0 27 Sep 2023
Label Deconvolution for Node Representation Learning on Large-scale Attributed Graphs against Learning Bias Zhihao Shi Jie Wang Fanghua Lu Hanzhu Chen Defu Lian Zheng Wang Jieping Ye Feng Wu AI4CE 32 6 0 26 Sep 2023
TouchUp-G: Improving Feature Representation through Graph-Centric Finetuning Jing Zhu Xiang Song V. Ioannidis Danai Koutra Christos Faloutsos 62 13 0 25 Sep 2023
When Large Language Models Meet Citation: A Survey Yang Zhang Yufei Wang Kai Wang Quan Z. Sheng Lina Yao A. Mahmood Wei Emma Zhang Rongying Zhao 50 7 0 18 Sep 2023
Augmenting Black-box LLMs with Medical Textbooks for Biomedical Question Answering Yubo Wang Xueguang Ma Wenhu Chen LM&MA AI4MH 47 9 0 05 Sep 2023
Large language models in medicine: the potentials and pitfalls J. Omiye Haiwen Gui Shawheen J. Rezaei James Zou Roxana Daneshjou LM&MA 23 65 0 31 Aug 2023
MedAlign: A Clinician-Generated Dataset for Instruction Following with Electronic Medical Records Scott L. Fleming Alejandro Lozano W. Haberkorn Jenelle A. Jindal E. Reis ... Jonathan H. Chen Keith Morse Emma Brunskill Jason Alan Fries N. Shah LM&MA 28 53 0 27 Aug 2023
BIOptimus: Pre-training an Optimal Biomedical Language Model with Curriculum Learning for Named Entity Recognition Vera Pavlova M. Makhlouf 19 3 0 16 Aug 2023
Through the Lens of Core Competency: Survey on Evaluation of Large Language Models Ziyu Zhuang Qiguang Chen Longxuan Ma Mingda Li Yi Han Yushan Qian Haopeng Bai Zixian Feng Weinan Zhang Ting Liu ELM 26 9 0 15 Aug 2023
Med-Flamingo: a Multimodal Medical Few-shot Learner Michael Moor Qian Huang Shirley Wu Michihiro Yasunaga C. Zakka Yashodhara Dalmia E. Reis Pranav Rajpurkar J. Leskovec LM&MA MedIm 27 232 0 27 Jul 2023
Matching Patients to Clinical Trials with Large Language Models Qiao Jin Zifeng Wang C. Floudas Fangyuan Chen Changlin Gong Dara Bracken-Clarke Elisabetta Xue Yifan Yang Jimeng Sun Zhiyong Lu LM&MA 28 91 0 27 Jul 2023
Text-guided Foundation Model Adaptation for Pathological Image Classification Yunkun Zhang Jinglei Gao Mu Zhou Xiaosong Wang Yu Qiao Shaoting Zhang Dequan Wang MedIm 19 47 0 27 Jul 2023
Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs Zhikai Chen Haitao Mao Hang Li Wei Jin Haifang Wen ... Shuaiqiang Wang Dawei Yin Wenqi Fan Hui Liu Jiliang Tang AI4CE 57 265 0 07 Jul 2023
DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications Adam Ivankay Mattia Rigotti P. Frossard OOD MedIm 26 1 0 05 Jul 2023
Biomedical Language Models are Robust to Sub-optimal Tokenization Bernal Jiménez Gutiérrez Huan Sun Yu-Chuan Su 22 6 0 30 Jun 2023
Weakly Supervised Multi-Label Classification of Full-Text Scientific Papers Yu Zhang Bowen Jin Xiusi Chen Yan-Jun Shen Yunyi Zhang Yu Meng Jiawei Han 38 13 0 24 Jun 2023
ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews Mike DÁrcy Alexis Ross Erin Bransom Bailey Kuehl Jonathan Bragg Tom Hope Doug Downey KELM 24 21 0 21 Jun 2023
SynerGPT: In-Context Learning for Personalized Drug Synergy Prediction and Drug Design Carl N. Edwards Aakanksha Naik Tushar Khot Martin Burke Heng Ji Tom Hope 30 14 0 19 Jun 2023