On Representation Knowledge Distillation for Graph Neural Networks

On Representation Knowledge Distillation for Graph Neural Networks

9 November 2021

Chaitanya K. Joshi

Fayao Liu

Chuan-Sheng Foo

Papers citing "On Representation Knowledge Distillation for Graph Neural Networks"

16 / 16 papers shown

Title
Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework Junxian Li Bin Shi Erfei Cui Hua Wei Qinghua Zheng 41 0 0 02 Mar 2024
Teacher-Student Architecture for Knowledge Distillation: A Survey Chengming Hu Xuan Li Danyang Liu Haolun Wu Xi Chen Ju Wang Xue Liu 21 16 0 08 Aug 2023
Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting it into MLPs: An Effective GNN-to-MLP Distillation Framework Lirong Wu Haitao Lin Yufei Huang Tianyu Fan Stan Z. Li 11 29 0 18 May 2023
Knowledge-Distilled Graph Neural Networks for Personalized Epileptic Seizure Detection Qinyue Zheng Arun Venkitaraman Simona Petravic P. Frossard FedML 18 1 0 03 Apr 2023
Graph-based Knowledge Distillation: A survey and experimental evaluation Jing Liu Tongya Zheng Guanzheng Zhang Qinfen Hao 29 8 0 27 Feb 2023
Knowledge Distillation on Graphs: A Survey Yijun Tian Shichao Pei Xiangliang Zhang Chuxu Zhang Nitesh V. Chawla 15 28 0 01 Feb 2023
Online Cross-Layer Knowledge Distillation on Graph Neural Networks with Deep Supervision Jiongyu Guo Defang Chen Can Wang 14 3 0 25 Oct 2022
SA-MLP: Distilling Graph Knowledge from GNNs into Structure-Aware MLP Jie Chen Shouzhen Chen Mingyuan Bai Junbin Gao Junping Zhang Jian Pu 34 10 0 18 Oct 2022
Linkless Link Prediction via Relational Distillation Zhichun Guo William Shiao Shichang Zhang Yozen Liu Nitesh V. Chawla Neil Shah Tong Zhao 21 41 0 11 Oct 2022
Pre-training Molecular Graph Representation with 3D Geometry Shengchao Liu Hanchen Wang Weiyang Liu Joan Lasenby Hongyu Guo Jian Tang 117 302 0 07 Oct 2021
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges M. Bronstein Joan Bruna Taco S. Cohen Petar Velivcković GNN 174 1,104 0 27 Apr 2021
Iterative Graph Self-Distillation Hanlin Zhang Shuai Lin Weiyang Liu Pan Zhou Jian Tang Xiaodan Liang Eric P. Xing SSL 57 33 0 23 Oct 2020
Distilling Knowledge from Graph Convolutional Networks Yiding Yang Jiayan Qiu Mingli Song Dacheng Tao Xinchao Wang 151 226 0 23 Mar 2020
Probabilistic Dual Network Architecture Search on Graphs Yiren Zhao Duo Wang Xitong Gao Robert D. Mullins Pietro Lió M. Jamnik GNN AI4CE 48 27 0 21 Mar 2020
Benchmarking Graph Neural Networks Vijay Prakash Dwivedi Chaitanya K. Joshi Anh Tuan Luu T. Laurent Yoshua Bengio Xavier Bresson 189 914 0 02 Mar 2020
MoleculeNet: A Benchmark for Molecular Machine Learning Zhenqin Wu Bharath Ramsundar Evan N. Feinberg Joseph Gomes C. Geniesse Aneesh S. Pappu K. Leswing Vijay S. Pande OOD 169 1,775 0 02 Mar 2017