Deep Bidirectional Language-Knowledge Graph Pretraining

17 October 2022

Christopher D. Manning

Percy Liang

J. Leskovec

ArXiv PDF HTML

Papers citing "Deep Bidirectional Language-Knowledge Graph Pretraining"

28 / 128 papers shown

Title
Similarity-weighted Construction of Contextualized Commonsense Knowledge Graphs for Knowledge-intense Argumentation Tasks Moritz Plenz Juri Opitz Philipp Heinisch Philipp Cimiano Anette Frank 27 9 0 15 May 2023
FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge Shangbin Feng Vidhisha Balachandran Yuyang Bai Yulia Tsvetkov KELM HILM 23 52 0 14 May 2023
Retrieval-based Knowledge Augmented Vision Language Pre-training Jiahua Rao Zifei Shan Long Liu Yao Zhou Yuedong Yang VLM 88 13 0 27 Apr 2023
Train Your Own GNN Teacher: Graph-Aware Distillation on Textual Graphs Costas Mavromatis V. Ioannidis Shen Wang Da Zheng Soji Adeshina Jun Ma Han Zhao Christos Faloutsos George Karypis 15 29 0 20 Apr 2023
On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligence Gengchen Mai Weiming Huang Jin Sun Suhang Song Deepak Mishra ... Yingjie Hu Chris Cundy Ziyuan Li Rui Zhu Ni Lao AI4CE 32 123 0 13 Apr 2023
Self-Supervised Multimodal Learning: A Survey Yongshuo Zong Oisin Mac Aodha Timothy M. Hospedales SSL 24 43 0 31 Mar 2023
Pre-training Transformers for Knowledge Graph Completion Sanxing Chen Hao Cheng Xiaodong Liu Jian Jiao Yangfeng Ji Jianfeng Gao 37 1 0 28 Mar 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 25 42 0 10 Mar 2023
Almanac: Retrieval-Augmented Language Models for Clinical Medicine C. Zakka Akash Chaurasia R. Shad Alex R. Dalal Jennifer L. Kim ... Kathleen Boyd Karen Hirsch C. Langlotz Joanna Nelson W. Hiesinger LM&MA 116 144 0 01 Mar 2023
IGB: Addressing The Gaps In Labeling, Features, Heterogeneity, and Size of Public Graph Datasets for Deep Learning Research Arpandeep Khatua Vikram Sharma Mailthody Bhagyashree Taleka Tengfei Ma Xiang Song Wen-mei W. Hwu AI4CE 48 37 0 27 Feb 2023
Large Language Models Encode Clinical Knowledge K. Singhal Shekoofeh Azizi T. Tu S. S. Mahdavi Jason W. Wei ... A. Rajkomar Joelle Barral Christopher Semturs Alan Karthikesalingam Vivek Natarajan LM&MA ELM AI4MH 24 2,173 0 26 Dec 2022
Graph Learning and Its Advancements on Large Language Models: A Holistic Survey Shaopeng Wei Yu Zhao Xingyan Chen Qing Li Fuzhen Zhuang Ji Liu Fuji Ren Gang Kou AI4CE 27 5 0 17 Dec 2022
A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodal K. Liang Lingyuan Meng Meng Liu Yue Liu Wenxuan Tu Siwei Wang Sihang Zhou Xinwang Liu Fu Sun LRM 26 108 0 12 Dec 2022
A Unified Knowledge Graph Augmentation Service for Boosting Domain-specific NLP Tasks Ruiqing Ding Xiao Han Leye Wang 36 1 0 10 Dec 2022
A Probabilistic-Logic based Commonsense Representation Framework for Modelling Inferences with Multiple Antecedents and Varying Likelihoods Shantanu Jaiswal Liu Yan Dongkyu Choi Kenneth Kwok 22 0 0 30 Nov 2022
Retrieval-Augmented Multimodal Language Modeling Michihiro Yasunaga Armen Aghajanyan Weijia Shi Rich James J. Leskovec Percy Liang M. Lewis Luke Zettlemoyer Wen-tau Yih RALM 16 95 0 22 Nov 2022
DR.BENCH: Diagnostic Reasoning Benchmark for Clinical Natural Language Processing Yanjun Gao Dmitriy Dligach Timothy A. Miller John R. Caskey Brihat Sharma M. Churpek Majid Afshar ELM LRM 34 17 0 29 Sep 2022
VQA-GNN: Reasoning with Multimodal Knowledge via Graph Neural Networks for Visual Question Answering Yanan Wang Michihiro Yasunaga Hongyu Ren Shinya Wada J. Leskovec 29 17 0 23 May 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 389 8,495 0 28 Jan 2022
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models Tianbao Xie Chen Henry Wu Peng Shi Ruiqi Zhong Torsten Scholak ... Lingpeng Kong Rui Zhang Noah A. Smith Luke Zettlemoyer Tao Yu LMTD 28 297 0 16 Jan 2022
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention Yichong Xu Chenguang Zhu Shuohang Wang Siqi Sun Hao Cheng Xiaodong Liu Jianfeng Gao Pengcheng He Michael Zeng Xuedong Huang LRM 254 55 0 06 Dec 2021
GNN is a Counter? Revisiting GNN for Question Answering Kuan-Chieh Jackson Wang Yuyu Zhang Diyi Yang Le Song Tao Qin LMTD 29 30 0 07 Oct 2021
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 35 5 0 01 Oct 2021
RiddleSense: Reasoning about Riddle Questions Featuring Linguistic Creativity and Commonsense Knowledge Bill Yuchen Lin Ziyi Wu Yichi Yang Dong-Ho Lee Xiang Ren ReLM LRM 236 64 0 02 Jan 2021
Learning Contextualized Knowledge Structures for Commonsense Reasoning Jun Yan Mrigank Raman Aaron Chan Tianyu Zhang Ryan Rossi Handong Zhao Sungchul Kim Nedim Lipka Xiang Ren 231 36 0 24 Oct 2020
K-BERT: Enabling Language Representation with Knowledge Graph Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Qi Ju Haotang Deng Ping Wang 231 778 0 17 Sep 2019
PubMedQA: A Dataset for Biomedical Research Question Answering Qiao Jin Bhuwan Dhingra Zhengping Liu William W. Cohen Xinghua Lu 234 812 0 13 Sep 2019
Knowledge Enhanced Contextual Word Representations Matthew E. Peters Mark Neumann IV RobertL.Logan Roy Schwartz Vidur Joshi Sameer Singh Noah A. Smith 231 656 0 09 Sep 2019