A Teacher-Free Graph Knowledge Distillation Framework with Dual Self-Distillation

6 March 2024

Lirong Wu

Stan Z. Li

Papers citing "A Teacher-Free Graph Knowledge Distillation Framework with Dual Self-Distillation"

35 / 35 papers shown

Title
Sparse Decomposition of Graph Neural Networks Yaochen Hu Mai Zeng Ge Zhang Pavel Rumiantsev Liheng Ma Yingxue Zhang Mark Coates 185 0 0 25 Oct 2024
MAPE-PPI: Towards Effective and Efficient Protein-Protein Interaction Prediction via Microenvironment-Aware Protein Embedding Lirong Wu Yijun Tian Yufei Huang Siyuan Li Haitao Lin Nitesh Chawla Stan Z. Li 62 23 0 22 Feb 2024
Quantifying the Knowledge in GNNs for Reliable Distillation into MLPs Lirong Wu Haitao Lin Yufei Huang Stan Z. Li 57 27 0 09 Jun 2023
Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting it into MLPs: An Effective GNN-to-MLP Distillation Framework Lirong Wu Haitao Lin Yufei Huang Tianyu Fan Stan Z. Li 83 29 0 18 May 2023
FreeKD: Free-direction Knowledge Distillation for Graph Neural Networks Kaituo Feng Changsheng Li Ye Yuan Guoren Wang 66 34 0 14 Jun 2022
Distilled Neural Networks for Efficient Learning to Rank F. M. Nardini Cosimo Rulli Salvatore Trani Rossano Venturini FedML 41 16 0 22 Feb 2022
InfoGCL: Information-Aware Graph Contrastive Learning Dongkuan Xu Wei Cheng Dongsheng Luo Haifeng Chen Xiang Zhang 61 198 0 28 Oct 2021
CCGL: Contrastive Cascade Graph Learning Xovee Xu Fan Zhou Kunpeng Zhang Siyuan Liu SSL 42 41 0 27 Jul 2021
Distilling Self-Knowledge From Contrastive Links to Classify Graph Nodes Without Passing Messages Yi Luo Aiguo Chen Ke Yan Ling Tian 56 15 0 16 Jun 2021
Training Graph Neural Networks with 1000 Layers Guohao Li Matthias Muller Guohao Li V. Koltun GNN AI4CE 84 240 0 14 Jun 2021
Graph-MLP: Node Classification without Message Passing in Graph Yang Hu Haoxuan You Zhecan Wang Zhicheng Wang Erjin Zhou Yue Gao 106 114 0 08 Jun 2021
Self-supervised Learning on Graphs: Contrastive, Generative,or Predictive Lirong Wu Haitao Lin Zhangyang Gao Cheng Tan Stan.Z.Li SSL 71 254 0 16 May 2021
Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Framework Cheng Yang Jiawei Liu C. Shi 65 128 0 04 Mar 2021
A Survey on Deep Semi-supervised Learning Xiangli Yang Zixing Song Irwin King Zenglin Xu 108 583 0 28 Feb 2021
Graph Neural Network for Traffic Forecasting: A Survey Weiwei Jiang Jiayun Luo GNN AI4TS AI4CE 216 874 0 27 Jan 2021
Conditional Local Convolution for Spatio-temporal Meteorological Forecasting Haitao Lin Zhangyang Gao Yongjie Xu Lirong Wu Ling Li Stan. Z. Li AI4TS 179 76 0 04 Jan 2021
Graph Contrastive Learning with Adaptive Augmentation Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu Liang Wang 82 1,110 0 27 Oct 2020
Iterative Graph Self-Distillation Hanlin Zhang Shuai Lin Weiyang Liu Pan Zhou Jian Tang Xiaodan Liang Eric Xing SSL 93 33 0 23 Oct 2020
Towards Deeper Graph Neural Networks Meng Liu Hongyang Gao Shuiwang Ji GNN AI4CE 98 606 0 18 Jul 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 371 6,806 0 13 Jun 2020
Distilling Knowledge from Graph Convolutional Networks Yiding Yang Jiayan Qiu Xiuming Zhang Dacheng Tao Xinchao Wang 210 232 0 23 Mar 2020
Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation Linfeng Zhang Jiebo Song Anni Gao Jingwei Chen Chenglong Bao Kaisheng Ma FedML 73 861 0 17 May 2019
Label Propagation for Deep Semi-supervised Learning Ahmet Iscen Giorgos Tolias Yannis Avrithis Ondřej Chum SSL 99 623 0 09 Apr 2019
A Comprehensive Survey on Graph Neural Networks Zonghan Wu Shirui Pan Fengwen Chen Guodong Long Chengqi Zhang Philip S. Yu FaML GNN AI4TS AI4CE 778 8,533 0 03 Jan 2019
Graph Neural Networks: A Review of Methods and Applications Jie Zhou Ganqu Cui Shengding Hu Zhengyan Zhang Cheng Yang Zhiyuan Liu Lifeng Wang Changcheng Li Maosong Sun AI4CE GNN 1.1K 5,517 0 20 Dec 2018
Predict then Propagate: Graph Neural Networks meet Personalized PageRank Johannes Klicpera Aleksandar Bojchevski Stephan Günnemann GNN 222 1,688 0 14 Oct 2018
FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling Jie Chen Tengfei Ma Cao Xiao GNN 144 1,513 0 30 Jan 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 479 20,164 0 30 Oct 2017
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 280 9,764 0 25 Oct 2017
Inductive Representation Learning on Large Graphs William L. Hamilton Z. Ying J. Leskovec 509 15,247 0 07 Jun 2017
Variational Graph Auto-Encoders Thomas Kipf Max Welling GNN BDL SSL CML 151 3,586 0 21 Nov 2016
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 641 29,076 0 09 Sep 2016
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering M. Defferrard Xavier Bresson P. Vandergheynst GNN 350 7,655 0 30 Jun 2016
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 313 6,681 0 08 Jun 2015
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 397 33,529 0 16 Oct 2013