CoLAKE: Contextualized Language and Knowledge Embedding

1 October 2020

Tianxiang Sun

Yunfan Shao

Xipeng Qiu

Qipeng Guo

Xuanjing Huang

Papers citing "CoLAKE: Contextualized Language and Knowledge Embedding"

50 / 84 papers shown

Title
ConceptFormer: Towards Efficient Use of Knowledge-Graph Embeddings in Large Language Models Joel Barmettler Abraham Bernstein Luca Rossetto KELM 3DV 49 0 0 10 Apr 2025
Synergistic Multi-Agent Framework with Trajectory Learning for Knowledge-Intensive Tasks Shengbin Yue Siyuan Wang Wei Chen Xuanjing Huang Zhongyu Wei LLMAG 80 9 0 03 Jan 2025
CommunityKG-RAG: Leveraging Community Structures in Knowledge Graphs for Advanced Retrieval-Augmented Generation in Fact-Checking Rong-Ching Chang Jiawei Zhang 49 2 0 16 Aug 2024
KEHRL: Learning Knowledge-Enhanced Language Representations with Hierarchical Reinforcement Learning Dongyang Li Taolin Zhang Longtao Huang Chengyu Wang Xiaofeng He Hui Xue KELM OffRL 33 0 0 24 Jun 2024
Enhance Robustness of Language Models Against Variation Attack through Graph Integration Ziteng Xiong Lizhi Qing Yangyang Kang Jiawei Liu Hongsong Li Changlong Sun Xiaozhong Liu Wei Lu 26 1 0 18 Apr 2024
KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation Xindi Luo Zequn Sun Jing-xin Zhao Zhe Zhao Wei Hu KELM 24 3 0 22 Mar 2024
TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models Junbing Yan Chengyu Wang Taolin Zhang Xiao-Mei He Junyuan Huang Longtao Huang Hui Xue Wei Zhang VLM KELM 32 0 0 17 Mar 2024
FGeo-TP: A Language Model-Enhanced Solver for Geometry Problems Yiming He Jia Zou Xiaokai Zhang Na Zhu Tuo Leng LRM 37 1 0 14 Feb 2024
Contextualization Distillation from Large Language Model for Knowledge Graph Completion Dawei Li Zhen Tan Tianlong Chen Huan Liu KELM 25 12 0 28 Jan 2024
ConcEPT: Concept-Enhanced Pre-Training for Language Models Xintao Wang Zhouhong Gu Jiaqing Liang Dakuan Lu Yanghua Xiao Wei Wang 34 1 0 11 Jan 2024
Large Knowledge Model: Perspectives and Challenges Huajun Chen KELM 56 9 0 05 Dec 2023
Learning Knowledge-Enhanced Contextual Language Representations for Domain Natural Language Understanding Ruyao Xu Taolin Zhang Chengyu Wang Zhongjie Duan Cen Chen Minghui Qiu Dawei Cheng Xiaofeng He Weining Qian 35 0 0 12 Nov 2023
InstructProtein: Aligning Human and Protein Language via Knowledge Instruction Zeyuan Wang Qiang Zhang Keyan Ding Ming Qin Zhuang Xiang Xiaotong Li Huajun Chen 33 28 0 05 Oct 2023
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning Jiadong Wang Chengyu Wang Chuanqi Tan Jun Huang Ming Gao KELM 34 4 0 26 Sep 2023
Exploring the Limits of Historical Information for Temporal Knowledge Graph Extrapolation Yi Xu Junjie Ou Hui Xu Luoyi Fu Lei Zhou Xinbing Wang Cheng Zhou AI4TS 34 0 0 29 Aug 2023
MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models Yilin Wen Zifeng Wang Jimeng Sun ReLM 49 67 0 17 Aug 2023
Multi-modal Graph Learning over UMLS Knowledge Graphs Manuel Burger Gunnar Rätsch Rita Kuznetsova 16 2 0 10 Jul 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 31 87 0 20 Jun 2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap Shirui Pan Linhao Luo Yufei Wang Chen Chen Jiapu Wang Xindong Wu KELM 35 719 0 14 Jun 2023
Triggering Multi-Hop Reasoning for Question Answering in Language Models using Soft Prompts and Random Walks Kanishka Misra Cicero Nogueira dos Santos Siamak Shakeri KELM LRM 21 1 0 06 Jun 2023
Plug-and-Play Knowledge Injection for Pre-trained Language Models Zhengyan Zhang Zhiyuan Zeng Yankai Lin Huadong Wang Deming Ye ... Xu Han Zhiyuan Liu Peng Li Maosong Sun Jie Zhou KELM 46 11 0 28 May 2023
ConGraT: Self-Supervised Contrastive Pretraining for Joint Graph and Text Embeddings William Brannon Wonjune Kang S. Fulay Hang Jiang Brandon Roy Dwaipayan Roy Jad Kabbara SSL 14 22 0 23 May 2023
KEPLET: Knowledge-Enhanced Pretrained Language Model with Topic Entity Awareness Yichuan Li Jialong Han Kyumin Lee Chengyuan Ma S. Sarkar Derek Liu VLM KELM 25 0 0 02 May 2023
UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models Deming Ye Yankai Lin Zhengyan Zhang Maosong Sun KELM 29 0 0 02 May 2023
Knowledge Enhanced Model for Live Video Comment Generation Jieting Chen Junkai Ding Wenping Chen Qin Jin VGen 17 5 0 28 Apr 2023
Understand the Dynamic World: An End-to-End Knowledge Informed Framework for Open Domain Entity State Tracking Mingchen Li Lifu Huang 54 9 0 26 Apr 2023
Incorporating Structured Sentences with Time-enhanced BERT for Fully-inductive Temporal Relation Prediction Zhongwu Chen Chengjin Xu Fenglong Su Zhen Huang Yong Dou 21 15 0 10 Apr 2023
Unsupervised Improvement of Factual Knowledge in Language Models Nafis Sadeq Byungkyu Kang Prarit Lamba Julian McAuley KELM 27 6 0 04 Apr 2023
G2PTL: A Pre-trained Model for Delivery Address and its Applications in Logistics System Lixia Wu Jianlin Liu Junhong Lou Haoyuan Hu Jianbin Zheng Haomin Wen Chao Song Shu He VLM 33 4 0 04 Apr 2023
GETT-QA: Graph Embedding based T2T Transformer for Knowledge Graph Question Answering Debayan Banerjee Pranav Ajit Nair Ricardo Usbeck Chris Biemann 21 9 0 23 Mar 2023
Text with Knowledge Graph Augmented Transformer for Video Captioning Xin Gu G. Chen Yufei Wang Libo Zhang Tiejian Luo Longyin Wen 27 47 0 22 Mar 2023
Unifying Structure Reasoning and Language Model Pre-training for Complex Reasoning Siyuan Wang Zhongyu Wei Jiarong Xu Taishan Li Zhihao Fan LRM 36 5 0 21 Jan 2023
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 32 3 0 27 Dec 2022
Embracing Ambiguity: Improving Similarity-oriented Tasks with Contextual Synonym Knowledge Yong Li Jiaoyan Chen Hai-Tao Zheng Tianyu Yu Xi Chen Haitao Zheng 14 13 0 20 Nov 2022
Temporal Knowledge Graph Reasoning with Historical Contrastive Learning Yi Xu Junjie Ou Hui Xu Luoyi Fu AI4TS 6 91 0 20 Nov 2022
A survey on knowledge-enhanced multimodal learning Maria Lymperaiou Giorgos Stamou 41 14 0 19 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 24 123 0 11 Nov 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining Nafis Sadeq Canwen Xu Julian McAuley 27 13 0 21 Oct 2022
Knowledge-Enhanced Relation Extraction Dataset Yucong Lin Hongming Xiao Jianing Liu Zichao Lin Keming Lu Feifei Wang Wei Wei 33 0 0 19 Oct 2022
Deep Bidirectional Language-Knowledge Graph Pretraining Michihiro Yasunaga Antoine Bosselut Hongyu Ren Xikun Zhang Christopher D. Manning Percy Liang J. Leskovec 36 193 0 17 Oct 2022
Knowledge Prompting in Pre-trained Language Model for Natural Language Understanding Jiadong Wang Wenkang Huang Qiuhui Shi Hongbin Wang Minghui Qiu Xiang Li Ming Gao KELM VLM 30 17 0 16 Oct 2022
Knowledge Prompts: Injecting World Knowledge into Language Models through Soft Prompts Cicero Nogueira dos Santos Zhe Dong Daniel Cer John Nham Siamak Shakeri Jianmo Ni Yun-hsuan Sung VLM KELM 17 8 0 10 Oct 2022
KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understanding Shangbin Feng Zhaoxuan Tan Wenqian Zhang Zhenyu Lei Yulia Tsvetkov KELM VLM 53 10 0 08 Oct 2022
The Lifecycle of "Facts": A Survey of Social Bias in Knowledge Graphs Angelie Kraft Ricardo Usbeck KELM 32 9 0 07 Oct 2022
Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledge Zhihong Chen Guanbin Li Xiang Wan 127 65 0 15 Sep 2022
Pre-training for Information Retrieval: Are Hyperlinks Fully Explored? Jiawen Wu Xinyu Zhang Yutao Zhu Zheng Liu Zikai Guo Zhaoye Fei Ruofei Lai Yongkang Wu Bo Zhao Zhicheng Dou 33 5 0 14 Sep 2022
LM-CORE: Language Models with Contextually Relevant External Knowledge Jivat Neet Kaur S. Bhatia Milan Aggarwal Rachit Bansal Balaji Krishnamurthy KELM 20 13 0 12 Aug 2022
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning Qianglong Chen Feng-Lin Li Guohai Xu Ming Yan Ji Zhang Yin Zhang 29 22 0 01 Aug 2022
TeKo: Text-Rich Graph Neural Networks with External Knowledge Zhizhi Yu Di Jin Jianguo Wei Ziyang Liu Yue Shang Yun Xiao Jiawei Han Lingfei Wu 32 4 0 15 Jun 2022
Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models Jinhao Jiang Kun Zhou Wayne Xin Zhao Ji-Rong Wen 19 15 0 04 May 2022