Deep Bidirectional Language-Knowledge Graph Pretraining

17 October 2022

Christopher D. Manning

Percy Liang

J. Leskovec

ArXiv PDF HTML

Papers citing "Deep Bidirectional Language-Knowledge Graph Pretraining"

50 / 128 papers shown

Title
RAS: Retrieval-And-Structuring for Knowledge-Intensive LLM Generation Pengcheng Jiang Lang Cao Ruike Zhu Minhao Jiang Yunyi Zhang J. Sun J. Han RALM 85 0 0 20 May 2025
Question-Aware Knowledge Graph Prompting for Enhancing Large Language Models Haochen Liu Song Wang Chen Chen J. Li RALM KELM 71 0 0 30 Mar 2025
Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactions Mohammad Almansoori K. K. Hisham Cholakkal 138 0 0 28 Mar 2025
The Graph's Apprentice: Teaching an LLM Low Level Knowledge for Circuit Quality Estimation Reza Moravej Saurabh Bodhe Zhanguang Zhang Didier Chetelat Dimitrios Tsaras Yingxue Zhang Hui-Ling Zhen Jianye Hao M. Yuan 55 1 0 17 Feb 2025
Large Language Models, Knowledge Graphs and Search Engines: A Crossroads for Answering Users' Questions Aidan Hogan Xin Luna Dong Denny Vrandečić Gerhard Weikum 52 1 0 12 Jan 2025
Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions Kai Sun Siyan Xue F. Sun Haoran Sun Yu-Juan Luo ... Xinzhou Wang Lei Yang Shuo Jin Jun Yan Jiahong Dong AI4CE 76 2 0 03 Dec 2024
MEG: Medical Knowledge-Augmented Large Language Models for Question Answering Laura Cabello Carmen Martin-Turrero Uchenna Akujuobi Anders Søgaard Carlos Bobed AI4MH 136 1 0 06 Nov 2024
Can Large Language Models Act as Ensembler for Multi-GNNs? Hanqi Duan Yao Cheng Jianxiang Yu Xiang Li AI4CE 35 0 0 22 Oct 2024
Privately Learning from Graphs with Applications in Fine-tuning Large Language Models Haoteng Yin Rongzhe Wei Eli Chien P. Li 28 0 0 10 Oct 2024
MUSE: Integrating Multi-Knowledge for Knowledge Graph Completion Pengjie Liu 18 0 0 26 Sep 2024
Internal and External Knowledge Interactive Refinement Framework for Knowledge-Intensive Question Answering Haowei Du Dongyan Zhao KELM 30 0 0 23 Aug 2024
Differentiating Choices via Commonality for Multiple-Choice Question Answering Wenqing Deng Zhe Wang Kewen Wang Shirui Pan Xiaowang Zhang Zhiyong Feng 39 0 0 21 Aug 2024
CommunityKG-RAG: Leveraging Community Structures in Knowledge Graphs for Advanced Retrieval-Augmented Generation in Fact-Checking Rong-Ching Chang Jiawei Zhang 49 2 0 16 Aug 2024
Medical Graph RAG: Towards Safe Medical Large Language Model via Graph Retrieval-Augmented Generation Junde Wu Jiayuan Zhu Yunli Qi 34 24 0 08 Aug 2024
Tree-of-Traversals: A Zero-Shot Reasoning Algorithm for Augmenting Black-box Language Models with Knowledge Graphs Elan Markowitz Anil Ramakrishna Jwala Dhamala Ninareh Mehrabi Charith Peris Rahul Gupta Kai-Wei Chang Aram Galstyan LRM 34 6 0 31 Jul 2024
Harvesting Textual and Structured Data from the HAL Publication Repository Francis Kulumba Wissam Antoun Guillaume Vimont Laurent Romary 32 2 0 30 Jul 2024
DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph Zhehao Zhang Jiaao Chen Diyi Yang LRM 37 8 0 25 Jun 2024
Enhancing Distractor Generation for Multiple-Choice Questions with Retrieval Augmented Pretraining and Knowledge Graph Integration Han-Cheng Yu Yu-An Shih Kin-Man Law Kai-Yu Hsieh Yu-Chen Cheng Hsin-Chih Ho Zih-An Lin Wen-Chuan Hsu Yao-Chung Fan 29 10 0 19 Jun 2024
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery Yu Zhang Xiusi Chen Bowen Jin Sheng Wang Shuiwang Ji Wei Wang Jiawei Han 44 27 0 16 Jun 2024
Text-space Graph Foundation Models: Comprehensive Benchmarks and New Insights Zhikai Chen Haitao Mao Jingzhe Liu Yu Song Bingheng Li ... Bahare Fatemi Anton Tsitsulin Bryan Perozzi Hui Liu Jiliang Tang 33 10 0 15 Jun 2024
EWEK-QA: Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems Mohammad Dehghan Mohammad Ali Alomrani Sunyam Bagga David Alfonso-Hermelo Khalil Bibi ... Jimmy Lin Boxing Chen Prasanna Parthasarathi Mahdi Biparva Mehdi Rezagholizadeh RALM 52 5 0 14 Jun 2024
Cross-Modality Program Representation Learning for Electronic Design Automation with High-Level Synthesis Zongyue Qin Yunsheng Bai Atefeh Sohrabizadeh Zijian Ding Ziniu Hu Yizhou Sun Jason Cong 28 1 0 13 Jun 2024
DARA: Decomposition-Alignment-Reasoning Autonomous Language Agent for Question Answering over Knowledge Graphs Haishuo Fang Xiaodan Zhu Iryna Gurevych AI4CE 32 1 0 11 Jun 2024
Compositional Generalization with Grounded Language Models Sondre Wold Étienne Simon Lucas Georges Gabriel Charpentier Egor V. Kostylev Erik Velldal Lilja Øvrelid KELM 29 0 0 07 Jun 2024
Pointer-Guided Pre-Training: Infusing Large Language Models with Paragraph-Level Contextual Awareness L. Hillebrand Prabhupad Pradhan Christian Bauckhage R. Sifa 21 0 0 06 Jun 2024
Multimodal Reasoning with Multimodal Knowledge Graph Junlin Lee Yequan Wang Jing Li Min Zhang 36 15 0 04 Jun 2024
GNN-RAG: Graph Neural Retrieval for Large Language Model Reasoning Costas Mavromatis George Karypis RALM LRM ReLM 62 51 0 30 May 2024
KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World Knowledge Pengcheng Jiang Lang Cao Cao Xiao Parminder Bhatia Jimeng Sun Jiawei Han AI4MH 41 2 0 26 May 2024
HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models Bernal Jiménez Gutiérrez Yiheng Shu Yu Gu Michihiro Yasunaga Yu-Chuan Su RALM CLL 65 33 0 23 May 2024
Towards Knowledge-Infused Automated Disease Diagnosis Assistant Mohit Tomar Abhisek Tiwari Sriparna Saha MedIm 26 3 0 18 May 2024
Generalizing Knowledge Graph Embedding with Universal Orthogonal Parameterization Rui Li Chaozhuo Li Yanming Shen Zeyu Zhang Xu Chen 43 2 0 14 May 2024
G-SAP: Graph-based Structure-Aware Prompt Learning over Heterogeneous Knowledge for Commonsense Reasoning Ruiting Dai Yuqiao Tan Lisi Mo Shuang Liang Guohao Huo Jiayi Luo Yao Cheng ReLM RALM LRM 35 0 0 09 May 2024
Graph Machine Learning in the Era of Large Language Models (LLMs) Wenqi Fan Shijie Wang Jiani Huang Zhikai Chen Yu Song ... Haitao Mao Hui Liu Xiaorui Liu Dawei Yin Qing Li AI4CE 31 23 0 23 Apr 2024
Privacy Preserving Prompt Engineering: A Survey Kennedy Edemacu Xintao Wu 41 18 0 09 Apr 2024
Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs Xiaoze Liu Feijie Wu Tianyang Xu Zhuo Chen Yichi Zhang Xiaoqian Wang Jing Gao HILM 39 8 0 01 Apr 2024
Developing Healthcare Language Model Embedding Spaces Niall Taylor Dan Schofield Andrey Kormilitzin Dan W Joyce A. Nevado-Holgado 35 0 0 28 Mar 2024
BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Text Elliot Bolton Abhinav Venigalla Michihiro Yasunaga David Leo Wright Hall Betty Xiong ... R. Daneshjou Jonathan Frankle Percy Liang Michael Carbin Christopher D. Manning LM&MA MedIm 32 50 0 27 Mar 2024
A Knowledge-Injected Curriculum Pretraining Framework for Question Answering Xin Lin Tianhuang Su Zhenya Huang Shangzi Xue Haifeng Liu Enhong Chen 28 1 0 11 Mar 2024
Evidence-Focused Fact Summarization for Knowledge-Augmented Zero-Shot Question Answering Sungho Ko Hyunjin Cho Hyungjoo Chae Jinyoung Yeo Dongha Lee RALM HILM 24 7 0 05 Mar 2024
EEE-QA: Exploring Effective and Efficient Question-Answer Representations Zhanghao Hu Yijun Yang Junjie Xu Yifu Qiu Pinzhen Chen 29 0 0 04 Mar 2024
To Generate or to Retrieve? On the Effectiveness of Artificial Contexts for Medical Open-Domain Question Answering Giacomo Frisoni Alessio Cocchieri Alex Presepi Gianluca Moro Zaiqiao Meng RALM MedIm 44 15 0 04 Mar 2024
Leveraging Biomolecule and Natural Language through Multi-Modal Learning: A Survey Qizhi Pei Lijun Wu Kaiyuan Gao Jinhua Zhu Yue Wang Zun Wang Tao Qin Rui Yan AI4CE 49 19 0 03 Mar 2024
MediSwift: Efficient Sparse Pre-trained Biomedical Language Models Vithursan Thangarasa Mahmoud Salem Shreyas Saxena Kevin Leong Joel Hestness Sean Lie MedIm 32 1 0 01 Mar 2024
JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering Capability Junda Wang Zhichao Yang Zonghai Yao Hong-ye Yu BDL AI4MH LRM 40 30 0 27 Feb 2024
DiffuCOMET: Contextual Commonsense Knowledge Diffusion Silin Gao Mete Ismayilzada Mengjie Zhao Hiromi Wakaki Yuki Mitsufuji Antoine Bosselut DiffM 35 0 0 26 Feb 2024
Can Language Models Act as Knowledge Bases at Scale? Qiyuan He Yizhong Wang Wenya Wang KELM LRM 29 8 0 22 Feb 2024
BiMediX: Bilingual Medical Mixture of Experts LLM Sara Pieri Sahal Shaji Mullappilly Fahad Shahbaz Khan Rao Muhammad Anwer Salman Khan Timothy Baldwin Hisham Cholakkal LM&MA 35 12 0 20 Feb 2024
Question Calibration and Multi-Hop Modeling for Temporal Question Answering Chao Xue Di Liang Pengfei Wang Jing Zhang 46 8 0 20 Feb 2024
Benchmarking Retrieval-Augmented Generation for Medicine Guangzhi Xiong Qiao Jin Zhiyong Lu Aidong Zhang RALM 80 151 0 20 Feb 2024
GLaM: Fine-Tuning Large Language Models for Domain Knowledge Graph Alignment via Neighborhood Partitioning and Generative Subgraph Encoding Stefan Dernbach Khushbu Agarwal Alejandro Zuniga Michael Henry Sutanay Choudhury 33 8 0 09 Feb 2024