A Survey of Pretraining on Graphs: Taxonomy, Methods, and Applications

16 February 2022

Stan Z. Li

Papers citing "A Survey of Pretraining on Graphs: Taxonomy, Methods, and Applications"

49 / 49 papers shown

Title
Motif-aware Attribute Masking for Molecular Graph Pre-training Eric Inae Gang Liu Meng Jiang AI4CE 64 14 0 08 Sep 2023
SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentation Jun Xia Lirong Wu Jintao Chen Bozhen Hu Stan Z. Li 46 285 0 07 Feb 2022
Bringing Your Own View: Graph Contrastive Learning without Prefabricated Data Augmentations Yuning You Tianlong Chen Zhangyang Wang Yang Shen SSL 60 61 0 04 Jan 2022
Molecular Contrastive Learning with Chemical Element Knowledge Graph Yin Fang Qiang Zhang Haihong Yang Xiang Zhuang Shumin Deng Wen Zhang Minghai Qin Zhuo Chen Xiaohui Fan Huajun Chen 43 110 0 01 Dec 2021
Pairwise Half-graph Discrimination: A Simple Graph-level Self-supervised Strategy for Pre-training Graph Neural Networks Pengyong Li Jun Wang Ziliang Li Yixuan Qiao Xianggen Liu Fei Ma Peng Gao Sen Song Guowang Xie SSL 43 16 0 26 Oct 2021
Pre-training Molecular Graph Representation with 3D Geometry Shengchao Liu Hanchen Wang Weiyang Liu Joan Lasenby Hongyu Guo Jian Tang 156 312 0 07 Oct 2021
Motif-based Graph Self-Supervised Learning for Molecular Property Prediction Zaixin Zhang Qi Liu Hao Wang Chengqiang Lu Chee-Kong Lee SSL AI4CE 74 253 0 03 Oct 2021
An Empirical Study of Graph Contrastive Learning Yanqiao Zhu Yichen Xu Qiang Liu Shu Wu 46 171 0 02 Sep 2021
Adaptive Transfer Learning on Graph Neural Networks Xueting Han Zhenhuan Huang Bang An Jing Bai 87 57 0 19 Jul 2021
From Canonical Correlation Analysis to Self-supervised Graph Neural Networks Hengrui Zhang Qitian Wu Junchi Yan David Wipf Philip S. Yu SSL 48 216 0 23 Jun 2021
Dual-view Molecule Pre-training Jinhua Zhu Yingce Xia Tao Qin Wen-gang Zhou Houqiang Li Tie-Yan Liu AI4CE 82 51 0 17 Jun 2021
ChemRL-GEM: Geometry Enhanced Molecular Representation Learning for Property Prediction Xiaomin Fang Lihang Liu Jieqiong Lei Donglong He Shanzhuo Zhang Jingbo Zhou Fan Wang Hua Wu Haifeng Wang AI4CE 38 443 0 11 Jun 2021
Graph Contrastive Learning Automated Yuning You Tianlong Chen Yang Shen Zhangyang Wang 68 463 0 10 Jun 2021
Self-supervised Graph-level Representation Learning with Local and Global Structure Minghao Xu Hang Wang Bingbing Ni Hongyu Guo Jian Tang SSL 29 206 0 08 Jun 2021
Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning Xiao Wang Nian Liu Hui-jun Han C. Shi SSL 54 379 0 19 May 2021
Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning Ming Jin Yizhen Zheng Yuan-Fang Li Chen Gong Chuan Zhou Shirui Pan SSL 106 153 0 12 May 2021
Graph Self-Supervised Learning: A Survey Yixin Liu Ming Jin Shirui Pan Chuan Zhou Yu Zheng Feng Xia Philip S. Yu SSL 72 555 0 27 Feb 2021
Graph Contrastive Learning with Adaptive Augmentation Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu Liang Wang 73 1,091 0 27 Oct 2020
Rethinking pooling in graph neural networks Diego Mesquita Amauri Souza Samuel Kaski GNN AI4CE 145 116 0 22 Oct 2020
GPT-GNN: Generative Pre-Training of Graph Neural Networks Ziniu Hu Yuxiao Dong Kuansan Wang Kai-Wei Chang Yizhou Sun SSL AI4CE 105 554 0 27 Jun 2020
GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training J. Qiu Qibin Chen Yuxiao Dong Jing Zhang Hongxia Yang Ming Ding Kuansan Wang Jie Tang SSL 179 942 0 17 Jun 2020
Contrastive Multi-View Representation Learning on Graphs Kaveh Hassani Amir Hosein Khas Ahmadi SSL 205 1,292 0 10 Jun 2020
Deep Graph Contrastive Representation Learning Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu Liang Wang SSL 59 804 0 07 Jun 2020
Principal Neighbourhood Aggregation for Graph Nets Gabriele Corso Luca Cavalleri Dominique Beaini Pietro Lio Petar Velickovic GNN 71 661 0 12 Apr 2020
Heterogeneous Graph Transformer Ziniu Hu Yuxiao Dong Kuansan Wang Yizhou Sun 263 1,183 0 03 Mar 2020
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing Ziqing Yang Yiming Cui Zhipeng Chen Wanxiang Che Ting Liu Shijin Wang Guoping Hu VLM 60 47 0 28 Feb 2020
Graph Representation Learning via Graphical Mutual Information Maximization Zhen Peng Wenbing Huang Minnan Luo Q. Zheng Yu Rong Tingyang Xu Junzhou Huang SSL 107 572 0 04 Feb 2020
Graph-Bert: Only Attention is Needed for Learning Graph Representations Jiawei Zhang Haopeng Zhang Congying Xia Li Sun 64 301 0 15 Jan 2020
Semi-Implicit Graph Variational Auto-Encoders Arman Hasanzadeh Ehsan Hajiramezanali N. Duffield Krishna R. Narayanan Mingyuan Zhou Xiaoning Qian BDL GNN 65 129 0 19 Aug 2019
Visualizing and Understanding the Effectiveness of BERT Y. Hao Li Dong Furu Wei Ke Xu 112 183 0 15 Aug 2019
InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization Fan-Yun Sun Jordan Hoffmann Vikas Verma Jian Tang SSL 143 852 0 31 Jul 2019
Pre-Training Graph Neural Networks for Generic Structural Feature Extraction Ziniu Hu Changjun Fan Ting-Li Chen Kai-Wei Chang Yizhou Sun 61 43 0 31 May 2019
Strategies for Pre-training Graph Neural Networks Weihua Hu Bowen Liu Joseph Gomes Marinka Zitnik Percy Liang Vijay S. Pande J. Leskovec SSL AI4CE 91 1,377 0 29 May 2019
A Comprehensive Survey on Graph Neural Networks Zonghan Wu Shirui Pan Fengwen Chen Guodong Long Chengqi Zhang Philip S. Yu FaML GNN AI4TS AI4CE 437 8,441 0 03 Jan 2019
Session-based Recommendation with Graph Neural Networks Shu Wu Yuyuan Tang Yanqiao Zhu Liang Wang Xing Xie Tieniu Tan GNN 63 1,549 0 01 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.2K 93,936 0 11 Oct 2018
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 197 7,554 0 01 Oct 2018
Deep Graph Infomax Petar Velickovic W. Fedus William L. Hamilton Pietro Lio Yoshua Bengio R. Devon Hjelm GNN 112 2,368 0 27 Sep 2018
N-Gram Graph: Simple Unsupervised Representation for Graphs, with Applications to Molecules Shengchao Liu M. F. Demirel Yingyu Liang GNN NAI 39 193 0 24 Jun 2018
SchNet: A continuous-filter convolutional neural network for modeling quantum interactions Kristof T. Schütt Pieter-Jan Kindermans Huziel Enoc Sauceda Felix Stefan Chmiela A. Tkatchenko K. Müller 127 1,069 0 26 Jun 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 521 129,831 0 12 Jun 2017
Variational Graph Auto-Encoders Thomas Kipf Max Welling GNN BDL SSL CML 121 3,559 0 21 Nov 2016
node2vec: Scalable Feature Learning for Networks Aditya Grover J. Leskovec 170 10,825 0 03 Jul 2016
subgraph2vec: Learning Distributed Representations of Rooted Sub-graphs from Large Graphs A. Narayanan Mahinthan Chandramohan Lihui Chen Yang Liu S. Saminathan GNN 48 156 0 29 Jun 2016
PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networks Jian Tang Meng Qu Qiaozhu Mei AI4TS SSL 69 789 0 02 Aug 2015
LINE: Large-scale Information Network Embedding Jian Tang Meng Qu Mingzhe Wang Ming Zhang Jun Yan Qiaozhu Mei GNN 123 5,323 0 12 Mar 2015
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho B. V. Merrienboer Çağlar Gülçehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk Yoshua Bengio AIMat 731 23,235 0 03 Jun 2014
DeepWalk: Online Learning of Social Representations Bryan Perozzi Rami Al-Rfou Steven Skiena HAI 241 9,735 0 26 Mar 2014
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 320 33,445 0 16 Oct 2013