A Survey of Knowledge Enhanced Pre-trained Language Models

v1v2v3v4 (latest)

A Survey of Knowledge Enhanced Pre-trained Language Models

11 November 2022

Lei Hou

Juanzi Li

ArXiv (abs)PDF HTML

Papers citing "A Survey of Knowledge Enhanced Pre-trained Language Models"

14 / 64 papers shown

Title
Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs O. Ovadia Menachem Brief Moshik Mishaeli Oren Elisha RALM 109 153 0 10 Dec 2023
BioLORD-2023: Semantic Textual Representations Fusing LLM and Clinical Knowledge Graph Insights François Remy Kris Demuynck Thomas Demeester 63 5 0 27 Nov 2023
Generalized Graph Prompt: Toward a Unification of Pre-Training and Downstream Tasks on Graphs Xingtong Yu Zhenghao Liu Yuan Fang Zemin Liu Sihong Chen Xinming Zhang 127 31 0 26 Nov 2023
Knowledge Graphs are not Created Equal: Exploring the Properties and Structure of Real KGs Nedelina Teneva Estevam R. Hruschka 66 1 0 10 Nov 2023
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances Zihan Zhang Meng Fang Lingxi Chen Mohammad-Reza Namazi-Rad Jun Wang KELM 96 24 0 11 Oct 2023
Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Neurons Yuheng Chen Pengfei Cao Yubo Chen Kang Liu Jun Zhao KELM 95 49 0 25 Aug 2023
LatEval: An Interactive LLMs Evaluation Benchmark with Incomplete Information from Lateral Thinking Puzzles Shulin Huang Shirong Ma Hai-Tao Zheng Mengzuo Huang Wuhe Zou Weidong Zhang Haitao Zheng LLMAG LRM 115 31 0 21 Aug 2023
Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs? Kai Sun Yongjun Xu Hanwen Zha Yue Liu Xinhsuai Dong AI4MH 127 148 0 20 Aug 2023
Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph Jiashuo Sun Chengjin Xu Lumingyuan Tang Saizhuo Wang Chen Lin Yeyun Gong Lionel M. Ni H. Shum Jian Guo LRM 102 83 0 15 Jul 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 110 93 0 20 Jun 2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap Shirui Pan Linhao Luo Yufei Wang Chen Chen Jiapu Wang Xindong Wu KELM 156 787 0 14 Jun 2023
Making a Computational Attorney Dell Zhang Frank Schilder Jack G. Conrad Masoud Makrehchi David von Rickenbach Isabelle Moulinier 62 1 0 07 Mar 2023
Graph Learning and Its Advancements on Large Language Models: A Holistic Survey Shaopeng Wei Yu Zhao Xingyan Chen Qing Li Fuzhen Zhuang Ji Liu Fuji Ren Gang Kou AI4CE 131 5 0 17 Dec 2022
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 82 6 0 01 Oct 2021