CoLAKE: Contextualized Language and Knowledge Embedding

1 October 2020

Tianxiang Sun

Yunfan Shao

Xipeng Qiu

Qipeng Guo

Xuanjing Huang

Papers citing "CoLAKE: Contextualized Language and Knowledge Embedding"

34 / 84 papers shown

Title
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing Chengyu Wang Minghui Qiu Chen Shi Taolin Zhang Tingting Liu Lei Li Jie Wang Ming Wang Jun Huang W. Lin 22 21 0 30 Apr 2022
Instilling Type Knowledge in Language Models via Multi-Task QA Shuyang Li Mukund Sridhar Chandan Prakash Jin Cao Wael Hamza Julian McAuley KELM 33 6 0 28 Apr 2022
Incorporating Explicit Knowledge in Pre-trained Language Models for Passage Re-ranking Qian Dong Yiding Liu Suqi Cheng Shuaiqiang Wang Zhicong Cheng Shuzi Niu Dawei Yin 32 24 0 25 Apr 2022
LinkBERT: Pretraining Language Models with Document Links Michihiro Yasunaga J. Leskovec Percy Liang KELM 29 353 0 29 Mar 2022
ECOLA: Enhanced Temporal Knowledge Embeddings with Contextualized Language Representations Zhen Han Ruotong Liao Jindong Gu Yao Zhang Zifeng Ding Yujia Gu Heinz Koeppl Hinrich Schütze Volker Tresp 15 8 0 17 Mar 2022
Multimodal Learning on Graphs for Disease Relation Extraction Yucong Lin Keming Lu Sheng Yu Tianxi Cai Marinka Zitnik 34 31 0 16 Mar 2022
A Simple Hash-Based Early Exiting Approach For Language Understanding and Generation Tianxiang Sun Xiangyang Liu Wei-wei Zhu Zhichao Geng Lingling Wu Yilong He Yuan Ni Guotong Xie Xuanjing Huang Xipeng Qiu 37 40 0 03 Mar 2022
A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models Deming Ye Yankai Lin Peng Li Maosong Sun Zhiyuan Liu KELM 14 11 0 27 Feb 2022
OntoProtein: Protein Pretraining With Gene Ontology Embedding Ningyu Zhang Zhen Bi Xiaozhuan Liang Shuyang Cheng Haosen Hong Shumin Deng J. Lian Qiang Zhang Huajun Chen 99 90 0 23 Jan 2022
GreaseLM: Graph REASoning Enhanced Language Models for Question Answering Xikun Zhang Antoine Bosselut Michihiro Yasunaga Hongyu Ren Percy Liang Christopher D. Manning J. Leskovec ReLM AI4MH LRM 22 220 0 21 Jan 2022
DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding Taolin Zhang Chengyu Wang Nan Hu Minghui Qiu Chengguang Tang Xiaofeng He Jun Huang KELM VLM 19 30 0 02 Dec 2021
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 29 45 0 16 Oct 2021
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline Xiangyang Liu Tianxiang Sun Junliang He Jiawen Wu Lingling Wu Xinyu Zhang Hao Jiang Bo Zhao Xuanjing Huang Xipeng Qiu ELM 28 46 0 13 Oct 2021
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 40 5 0 01 Oct 2021
Paradigm Shift in Natural Language Processing Tianxiang Sun Xiangyang Liu Xipeng Qiu Xuanjing Huang 126 82 0 26 Sep 2021
K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering Fu Sun Feng-Lin Li Ruize Wang Qianglong Chen Xingyi Cheng Ji Zhang VLM KELM 36 4 0 22 Sep 2021
Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT Zaiqiao Meng Fangyu Liu T. H. Clark Ehsan Shareghi Nigel Collier MoE 47 37 0 10 Sep 2021
KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs Yinquan Lu H. Lu Guirong Fu Qun Liu KELM 18 34 0 09 Sep 2021
AR-BERT: Aspect-relation enhanced Aspect-level Sentiment Classification with Multi-modal Explanations Sk Mainul Islam Sourangshu Bhattacharya 19 11 0 26 Aug 2021
SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining Taolin Zhang Zerui Cai Chengyu Wang Minghui Qiu Bite Yang Xiaofeng He AI4MH 28 52 0 20 Aug 2021
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation Yu Sun Shuohuan Wang Shikun Feng Siyu Ding Chao Pang ... Ouyang Xuan Dianhai Yu Hao Tian Hua Wu Haifeng Wang 61 454 0 05 Jul 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 58 816 0 14 Jun 2021
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 42 18 0 18 Mar 2021
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning Yujia Qin Yankai Lin Ryuichi Takanobu Zhiyuan Liu Peng Li Heng Ji Minlie Huang Maosong Sun Jie Zhou 55 125 0 30 Dec 2020
JAKET: Joint Pre-training of Knowledge Graph and Language Understanding Donghan Yu Chenguang Zhu Yiming Yang Michael Zeng KELM 11 142 0 02 Oct 2020
CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models Yusheng Su Xu Han Zhengyan Zhang Peng Li Zhiyuan Liu Yankai Lin Jie Zhou Maosong Sun ODL 23 24 0 29 Sep 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,452 0 18 Mar 2020
A Survey on Knowledge Graphs: Representation, Acquisition and Applications Shaoxiong Ji Shirui Pan Min Zhang Pekka Marttinen Philip S. Yu 195 1,941 0 02 Feb 2020
K-BERT: Enabling Language Representation with Knowledge Graph Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Qi Ju Haotang Deng Ping Wang 231 778 0 17 Sep 2019
Knowledge Enhanced Contextual Word Representations Matthew E. Peters Mark Neumann IV RobertL.Logan Roy Schwartz Vidur Joshi Sameer Singh Noah A. Smith 234 656 0 09 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 446 2,589 0 03 Sep 2019
Global Entity Disambiguation with BERT Ikuya Yamada Koki Washio Hiroyuki Shindo Yuji Matsumoto 16 31 0 01 Sep 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 299 6,984 0 20 Apr 2018
Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguation Ikuya Yamada Hiroyuki Shindo Hideaki Takeda Yoshiyasu Takefuji 133 318 0 06 Jan 2016