v1v2v3v4 (latest)

Fast-and-Frugal Text-Graph Transformers are Effective Link Predictors

13 August 2024

Andrei Catalin Coman

Christos Theodoropoulos

Marie-Francine Moens

James Henderson

ArXiv (abs)PDF HTML

Papers citing "Fast-and-Frugal Text-Graph Transformers are Effective Link Predictors"

50 / 52 papers shown

Title
Transformers as Graph-to-Graph Models James Henderson Alireza Mohammadshahi Andrei Catalin Coman Lesly Miculicich GNN 58 6 0 27 Oct 2023
Strong and Efficient Baselines for Open Domain Conversational Question Answering Andrei Catalin Coman Gianni Barlacchi Adria de Gispert 43 3 0 23 Oct 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 94 92 0 20 Jun 2023
LLaMA: Open and Efficient Foundation Language Models Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux ... Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave Guillaume Lample ALM PILM 1.5K 13,472 0 27 Feb 2023
UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph Jinhao Jiang Kun Zhou Wayne Xin Zhao Ji-Rong Wen RALM 107 84 0 02 Dec 2022
A Decade of Knowledge Graphs in Natural Language Processing: A Survey Phillip Schneider Tim Schopf Juraj Vladika Mikhail Galkin Elena Simperl Florian Matthes 127 61 0 30 Sep 2022
Graph Refinement for Coreference Resolution Lesly Miculicich James Henderson 109 12 0 30 Mar 2022
Sequence-to-Sequence Knowledge Graph Completion and Question Answering Apoorv Saxena Adrian Kochsiek Rainer Gemulla AIMat 118 128 0 19 Mar 2022
TableFormer: Robust Transformer Modeling for Table-Text Encoding Jingfeng Yang Aditya Gupta Shyam Upadhyay Luheng He Rahul Goel Shachi Paul LMTD 72 117 0 01 Mar 2022
Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning Christos Theodoropoulos James Henderson Andrei Catalin Coman Marie-Francine Moens 39 15 0 02 Sep 2021
NodePiece: Compositional and Parameter-Efficient Representations of Large Knowledge Graphs Mikhail Galkin E. Denis Jiapeng Wu William L. Hamilton OCL 62 90 0 23 Jun 2021
JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs Pei Ke Haozhe Ji Yuanyuan Ran Xin Cui Liwei Wang Linfeng Song Xiaoyan Zhu Minlie Huang 94 95 0 19 Jun 2021
Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Prediction Zhaocheng Zhu Zuobai Zhang Louis-Pascal Xhonneux Jian Tang GNN 97 325 0 13 Jun 2021
Do Transformers Really Perform Bad for Graph Representation? Chengxuan Ying Tianle Cai Shengjie Luo Shuxin Zheng Guolin Ke Di He Yanming Shen Tie-Yan Liu GNN 99 443 0 09 Jun 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 315 2,521 0 20 Apr 2021
Inductive Relation Prediction by BERT H. Zha Zhiyu Zoey Chen Xifeng Yan 137 58 0 12 Mar 2021
Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction Benfeng Xu Quan Wang Yajuan Lyu Yong Zhu Zhendong Mao 93 169 0 20 Feb 2021
Inductive Entity Representations from Text via Link Prediction Daniel Daza Michael Cochez Paul T. Groth 75 112 0 07 Oct 2020
Inductively Representing Out-of-Knowledge-Graph Entities by Optimal Estimation Under Translational Assumptions Damai Dai Hua Zheng Fuli Luo Pengcheng Yang Baobao Chang Zhifang Sui 38 16 0 27 Sep 2020
HittER: Hierarchical Transformers for Knowledge Graph Embeddings Sanxing Chen Xiaodong Liu Jianfeng Gao Jian Jiao Ruofei Zhang Yangfeng Ji 69 113 0 28 Aug 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 882 42,463 0 28 May 2020
Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement Alireza Mohammadshahi James Henderson 60 34 0 29 Mar 2020
Relational Message Passing for Knowledge Graph Completion Hongwei Wang Hongyu Ren J. Leskovec 64 120 0 17 Feb 2020
GLU Variants Improve Transformer Noam M. Shazeer 139 1,022 0 12 Feb 2020
On Layer Normalization in the Transformer Architecture Ruibin Xiong Yunchang Yang Di He Kai Zheng Shuxin Zheng Chen Xing Huishuai Zhang Yanyan Lan Liwei Wang Tie-Yan Liu AI4CE 145 996 0 12 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 547 42,639 0 03 Dec 2019
Inductive Relation Prediction by Subgraph Reasoning Komal K. Teru E. Denis William L. Hamilton NAI AI4CE 90 398 0 16 Nov 2019
KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation Xiaozhi Wang Tianyu Gao Zhaocheng Zhu Zhengyan Zhang Zhiyuan Liu Juan-Zi Li Jian Tang 121 670 0 13 Nov 2019
Graph-to-Graph Transformer for Transition-based Dependency Parsing Alireza Mohammadshahi James Henderson AI4CE 24 26 0 08 Nov 2019
Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphs Houyu Zhang Zhenghao Liu Chenyan Xiong Zhiyuan Liu 103 149 0 07 Nov 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 488 20,342 0 23 Oct 2019
Commonsense Knowledge Base Completion with Structural and Semantic Context Chaitanya Malaviya Chandra Bhagavatula Antoine Bosselut Yejin Choi 90 140 0 07 Oct 2019
KG-BERT: BERT for Knowledge Graph Completion Liang Yao Chengsheng Mao Yuan Luo SLR 82 593 0 07 Sep 2019
On the Variance of the Adaptive Learning Rate and Beyond Liyuan Liu Haoming Jiang Pengcheng He Weizhu Chen Xiaodong Liu Jianfeng Gao Jiawei Han ODL 294 1,908 0 08 Aug 2019
An Open-World Extension to Knowledge Graph Completion Models Haseeb Shah Johannes Villmow A. Ulges Ulrich Schwanecke Faisal Shafait VLM 53 78 0 19 Jun 2019
Barack's Wife Hillary: Using Knowledge-Graphs for Fact-Aware Language Modeling IV RobertL.Logan Nelson F. Liu Matthew E. Peters Matt Gardner Sameer Singh RALM 73 189 0 17 Jun 2019
COMET: Commonsense Transformers for Automatic Knowledge Graph Construction Antoine Bosselut Hannah Rashkin Maarten Sap Chaitanya Malaviya Asli Celikyilmaz Yejin Choi 82 913 0 12 Jun 2019
RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space Zhiqing Sun Zhihong Deng Jian-Yun Nie Jian Tang 108 2,142 0 26 Feb 2019
Logic Attention Based Neighborhood Aggregation for Inductive Knowledge Graph Embedding Peifeng Wang Jialong Han Chenliang Li Rong Pan NAI GNN 69 159 0 04 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,229 0 11 Oct 2018
Hypernetwork Knowledge Graph Embeddings Ivana Balazevic Carl Allen Timothy M. Hospedales GNN 65 185 0 21 Aug 2018
SimplE Embedding for Link Prediction in Knowledge Graphs Seyed Mehran Kazemi David Poole 76 720 0 13 Feb 2018
TorusE: Knowledge Graph Embedding on a Lie Group Takuma Ebisu R. Ichise 59 209 0 15 Nov 2017
Open-World Knowledge Graph Completion Baoxu Shi Tim Weninger 70 292 0 09 Nov 2017
Convolutional 2D Knowledge Graph Embeddings Tim Dettmers Pasquale Minervini Pontus Stenetorp Sebastian Riedel GNN 3DV 195 2,630 0 05 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 795 132,454 0 12 Jun 2017
Neural Message Passing for Quantum Chemistry Justin Gilmer S. Schoenholz Patrick F. Riley Oriol Vinyals George E. Dahl 598 7,496 0 04 Apr 2017
Modeling Relational Data with Graph Convolutional Networks Michael Schlichtkrull Thomas Kipf Peter Bloem Rianne van den Berg Ivan Titov Max Welling GNN 194 4,837 0 17 Mar 2017
Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning Stefan Elfwing E. Uchibe Kenji Doya 136 1,746 0 10 Feb 2017
Complex Embeddings for Simple Link Prediction Théo Trouillon Johannes Welbl Sebastian Riedel Éric Gaussier Guillaume Bouchard BDL 103 2,988 0 20 Jun 2016