Deep Bidirectional Language-Knowledge Graph Pretraining

17 October 2022

Christopher D. Manning

Percy Liang

J. Leskovec

ArXiv PDF HTML

Papers citing "Deep Bidirectional Language-Knowledge Graph Pretraining"

50 / 128 papers shown

Title
EntGPT: Linking Generative Large Language Models with Knowledge Bases Yifan Ding Amrit Poudel Qingkai Zeng Tim Weninger Balaji Veeramani Sanmitra Bhattacharya ReLM KELM LRM 31 4 0 09 Feb 2024
Similarity-based Neighbor Selection for Graph LLMs Rui Li Jiwei Li Jiawei Han Guoyin Wang 24 3 0 06 Feb 2024
Progress and Opportunities of Foundation Models in Bioinformatics Qing Li Zhihang Hu Yixuan Wang Lei Li Yimin Fan Irwin King Le Song Yu-Hu Li AI4CE 40 9 0 06 Feb 2024
SemPool: Simple, robust, and interpretable KG pooling for enhancing language models Costas Mavromatis Petros Karypis George Karypis KELM RALM 50 2 0 03 Feb 2024
Position: Graph Foundation Models are Already Here Haitao Mao Zhikai Chen Wenzhuo Tang Jianan Zhao Yao Ma Tong Zhao Neil Shah Mikhail Galkin Jiliang Tang AI4CE 64 26 0 03 Feb 2024
Developing ChatGPT for Biology and Medicine: A Complete Review of Biomedical Question Answering Qing Li Lei Li Yu Li LM&MA AI4MH 41 6 0 15 Jan 2024
Graph Language Models Moritz Plenz Anette Frank KELM AI4CE 28 5 0 13 Jan 2024
KnowGPT: Knowledge Graph based Prompting for Large Language Models Qinggang Zhang Junnan Dong Hao Chen Daochen Zha Zailiang Yu Xiao Huang KELM RALM 24 5 0 11 Dec 2023
Large Language Models on Graphs: A Comprehensive Survey Bowen Jin Gang Liu Chi Han Meng Jiang Heng Ji Jiawei Han AI4CE 31 138 0 05 Dec 2023
CLOMO: Counterfactual Logical Modification with Large Language Models Yinya Huang Ruixin Hong Hongming Zhang Wei Shao Zhicheng YANG Dong Yu Changshui Zhang Xiaodan Liang Linqi Song LRM 34 7 0 29 Nov 2023
Biomedical knowledge graph-optimized prompt generation for large language models Karthik Soman Peter W Rose John H Morris Rabia E Akbas Brett Smith ... Angela Rizk-Jackson Sharat Israni Charlotte A. Nelson Sui Huang Sergio Baranzini AI4MH 24 24 0 29 Nov 2023
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine Harsha Nori Yin Tat Lee Sheng Zhang Dean Carignan Richard Edgar ... Hoifung Poon Tao Qin Naoto Usuyama Chris White Eric Horvitz LM&MA AI4MH MedIm ELM 32 294 0 28 Nov 2023
MEDITRON-70B: Scaling Medical Pretraining for Large Language Models Zeming Chen Alejandro Hernández Cano Angelika Romanou Antoine Bonnet Kyle Matoba ... Axel Marmet Syrielle Montariol Mary-Anne Hartley Martin Jaggi Antoine Bosselut LM&MA AI4MH MedIm 37 179 0 27 Nov 2023
Large Language Models as Topological Structure Enhancers for Text-Attributed Graphs Shengyin Sun Yuxiang Ren Chen Ma Xuecang Zhang 113 20 0 24 Nov 2023
AutoKG: Efficient Automated Knowledge Graph Generation for Language Models Bohan Chen Andrea L. Bertozzi 22 9 0 22 Nov 2023
A Survey of Large Language Models in Medicine: Progress, Application, and Challenge Hongjian Zhou Fenglin Liu Boyang Gu Xinyu Zou Jinfa Huang ... Yefeng Zheng Lei A. Clifton Zheng Li Fenglin Liu David A. Clifton LM&MA 33 107 0 09 Nov 2023
Characterizing Large Language Models as Rationalizers of Knowledge-intensive Tasks Aditi Mishra Sajjadur Rahman H. Kim Kushan Mitra Estevam R. Hruschka 21 6 0 09 Nov 2023
Gold: A Global and Local-aware Denoising Framework for Commonsense Knowledge Graph Noise Detection Zheye Deng Weiqi Wang Zhaowei Wang Xin Liu Yangqiu Song 33 9 0 18 Oct 2023
KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models Yuyang Bai Shangbin Feng Vidhisha Balachandran Zhaoxuan Tan Shiqi Lou Tianxing He Yulia Tsvetkov ELM 40 2 0 15 Oct 2023
GraphextQA: A Benchmark for Evaluating Graph-Enhanced Large Language Models Yuanchun Shen Ruotong Liao Zhen Han Yunpu Ma Volker Tresp 32 1 0 12 Oct 2023
Talk like a Graph: Encoding Graphs for Large Language Models Bahare Fatemi Jonathan J. Halcrow Bryan Perozzi AI4CE 25 94 0 06 Oct 2023
Large Language Models as Analogical Reasoners Michihiro Yasunaga Xinyun Chen Yujia Li Panupong Pasupat J. Leskovec Percy Liang Ed H. Chi Denny Zhou ReLM LRM 26 77 0 03 Oct 2023
Graph Neural Prompting with Large Language Models Yijun Tian Huan Song Zichen Wang Haozhu Wang Ziqing Hu Fang Wang Nitesh V. Chawla Panpan Xu AI4CE 37 44 0 27 Sep 2023
Knowledge Solver: Teaching LLMs to Search for Domain Knowledge from Knowledge Graphs Chao Feng Xinyu Zhang Zichu Fei KELM 25 45 0 06 Sep 2023
Large language models in medicine: the potentials and pitfalls J. Omiye Haiwen Gui Shawheen J. Rezaei James Zou Roxana Daneshjou LM&MA 23 65 0 31 Aug 2023
Enhancing PLM Performance on Labour Market Tasks via Instruction-based Finetuning and Prompt-tuning with Rules Jarno Vrolijk David Graus 32 2 0 31 Aug 2023
Leveraging Medical Knowledge Graphs Into Large Language Models for Diagnosis Prediction: Design and Application Study Yanjun Gao Ruizhe Li John R. Caskey Dmitriy Dligach T. Miller M. Churpek Majid Afshar Dmitriy Dligach Majid Afshar LM&MA 22 5 0 28 Aug 2023
Knowledge Graph Prompting for Multi-Document Question Answering Yu-Chiang Frank Wang Nedim Lipka Ryan A. Rossi Alexa F. Siu Ruiyi Zhang Tyler Derr RALM 31 114 0 22 Aug 2023
MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models Yilin Wen Zifeng Wang Jimeng Sun ReLM 49 67 0 17 Aug 2023
Med-Flamingo: a Multimodal Medical Few-shot Learner Michael Moor Qian Huang Shirley Wu Michihiro Yasunaga C. Zakka Yashodhara Dalmia E. Reis Pranav Rajpurkar J. Leskovec LM&MA MedIm 27 232 0 27 Jul 2023
Multi-modal Graph Learning over UMLS Knowledge Graphs Manuel Burger Gunnar Rätsch Rita Kuznetsova 11 2 0 10 Jul 2023
Fairness-Aware Graph Neural Networks: A Survey April Chen Ryan A. Rossi Namyong Park Puja Trivedi Yu-Chiang Frank Wang Tong Yu Sungchul Kim Franck Dernoncourt Nesreen K. Ahmed 33 9 0 08 Jul 2023
Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs Zhikai Chen Haitao Mao Hang Li Wei Jin Haifang Wen ... Shuaiqiang Wang Dawei Yin Wenqi Fan Hui Liu Jiliang Tang AI4CE 57 265 0 07 Jul 2023
Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages Yasmine Karoui R. Lebret Negar Foroutan Karl Aberer MLLM VLM 32 1 0 29 Jun 2023
Structuring Representation Geometry with Rotationally Equivariant Contrastive Learning Sharut Gupta Joshua Robinson Derek Lim Soledad Villar Stefanie Jegelka SSL 29 17 0 24 Jun 2023
Exploring New Frontiers in Agricultural NLP: Investigating the Potential of Large Language Models for Food Applications Saed Rezayi Zheng Liu Zihao Wu Chandra Dhakal Bao Ge ... Gengchen Mai Ninghao Liu Chen Zhen Tianming Liu Sheng Li 26 32 0 20 Jun 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 29 87 0 20 Jun 2023
Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health Shubo Tian Qiao Jin Lana Yeganova Po-Ting Lai Qingqing Zhu ... Donald C. Comeau R. Islamaj Aadit Kapoor Xin Gao Zhiyong Lu LM&MA MedIm AI4MH 109 210 0 15 Jun 2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap Shirui Pan Linhao Luo Yufei Wang Chen Chen Jiapu Wang Xindong Wu KELM 35 715 0 14 Jun 2023
Text-To-KG Alignment: Comparing Current Methods on Classification Tasks Sondre Wold Lilja Ovrelid Erik Velldal 22 3 0 05 Jun 2023
Graph-Aware Language Model Pre-Training on a Large Graph Corpus Can Help Multiple Graph Applications Han Xie Da Zheng Jun Ma Houyu Zhang V. Ioannidis ... Sheng Wang Carl Yang Yi Xu Belinda Zeng Trishul Chilimbi AI4CE 22 35 0 05 Jun 2023
Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learning Xiaoxin He Xavier Bresson T. Laurent Adam Perold Yann LeCun Bryan Hooi 31 71 0 31 May 2023
Graph Reasoning for Question Answering with Triplet Retrieval Shiyang Li Yifan Gao Hao Jiang Qingyu Yin Zheng Li Xifeng Yan Chao Zhang Bing Yin RALM ReLM 18 29 0 30 May 2023
Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Models Yuhui Zhang Michihiro Yasunaga Zhengping Zhou Jeff Z. HaoChen James Zou Percy Liang Serena Yeung 47 7 0 27 May 2023
BUCA: A Binary Classification Approach to Unsupervised Commonsense Question Answering Jie He U. SimonChiLok Víctor Gutiérrez-Basulto Jeff Z. Pan 41 10 0 25 May 2023
Knowledge Graphs Querying Arijit Khan 31 16 0 23 May 2023
Enhancing Small Medical Learners with Privacy-preserving Contextual Prompting Xinlu Zhang Shiyang Li Xianjun Yang Chenxin Tian Yao Qin Linda R. Petzold 24 9 0 22 May 2023
AutoTrial: Prompting Language Models for Clinical Trial Design Zifeng Wang Cao Xiao Jimeng Sun LM&MA LRM 8 15 0 19 May 2023
ProgSG: Cross-Modality Representation Learning for Programs in Electronic Design Automation Yunsheng Bai Atefeh Sohrabizadeh Zongyue Qin Ziniu Hu Yizhou Sun Jason Cong 23 1 0 18 May 2023
Knowledge Rumination for Pre-trained Language Models Yunzhi Yao Peng Wang Shengyu Mao Chuanqi Tan Fei Huang Huajun Chen Ningyu Zhang KELM 30 3 0 15 May 2023