Graph-based Knowledge Distillation: A survey and experimental evaluation

27 February 2023

ArXiv (abs)PDF HTML Github (68★)

Papers citing "Graph-based Knowledge Distillation: A survey and experimental evaluation"

48 / 48 papers shown

Title
On Representation Knowledge Distillation for Graph Neural Networks Chaitanya K. Joshi Fayao Liu Xu Xun Jie Lin Chuan-Sheng Foo 75 62 0 09 Nov 2021
Conditional Attention Networks for Distilling Knowledge Graphs in Recommendation Ke Tu Peng Cui Daixin Wang Qing Cui Jun Zhou Yuan Qi Wenwu Zhu 75 46 0 03 Nov 2021
Meta-Knowledge Transfer for Inductive Knowledge Graph Embedding Yin Hua Wen Zhang Yushan Zhu Hongting Zhou Zonggang Yuan Changliang Xu Hua-zeng Chen 53 58 0 27 Oct 2021
Deep Structured Instance Graph for Distilling Object Detectors Yixin Chen Pengguang Chen Shu Liu Liwei Wang Jiaya Jia ObjD ISeg 49 12 0 27 Sep 2021
ROD: Reception-aware Online Distillation for Sparse Graphs Wentao Zhang Yuezihan Jiang Yang Li Zeang Sheng Yu Shen Xupeng Miao Liang Wang Zhi-Xin Yang Tengjiao Wang 58 24 0 25 Jul 2021
Distilling Self-Knowledge From Contrastive Links to Classify Graph Nodes Without Passing Messages Yi Luo Aiguo Chen Ke Yan Ling Tian 56 15 0 16 Jun 2021
Survey of Image Based Graph Neural Networks U. Nazir He Wang M. Taj GNN 41 6 0 11 Jun 2021
Graph Consistency Based Mean-Teaching for Unsupervised Domain Adaptive Person Re-Identification Xiaobing Liu Shiliang Zhang 68 29 0 11 May 2021
KDExplainer: A Task-oriented Attention Model for Explaining Knowledge Distillation Mengqi Xue Mingli Song Xinchao Wang Ying Chen Xingen Wang Xiuming Zhang 36 10 0 10 May 2021
Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Framework Cheng Yang Jiawei Liu C. Shi 65 128 0 04 Mar 2021
Binary Graph Neural Networks Mehdi Bahri Gaétan Bahl Stefanos Zafeiriou GNN AI4CE 40 53 0 31 Dec 2020
EGAD: Evolving Graph Representation Learning with Self-Attention and Knowledge Distillation for Live Video Streaming Events Stefanos Antaris Dimitrios Rafailidis Sarunas Girdzijauskas 40 5 0 11 Nov 2020
Graph Neural Networks in Recommender Systems: A Survey Shiwen Wu Fei Sun Wentao Zhang Xu Xie Tengjiao Wang GNN 142 1,230 0 04 Nov 2020
Iterative Graph Self-Distillation Hanlin Zhang Shuai Lin Weiyang Liu Pan Zhou Jian Tang Xiaodan Liang Eric Xing SSL 93 33 0 23 Oct 2020
Mutual Teaching for Graph Convolutional Networks Kun Zhan Chaoxi Niu SSL 44 32 0 02 Sep 2020
Heterogeneous Knowledge Distillation using Information Flow Modeling Nikolaos Passalis Maria Tzelepi Anastasios Tefas 61 139 0 02 May 2020
Inter-Region Affinity Distillation for Road Marking Segmentation Yuenan Hou Zheng Ma Chunxiao Liu Tak-Wai Hui Chen Change Loy 68 123 0 11 Apr 2020
Spatio-Temporal Graph for Video Captioning with Knowledge Distillation Boxiao Pan Haoye Cai De-An Huang Kuan-Hui Lee Adrien Gaidon Ehsan Adeli Juan Carlos Niebles 64 236 0 31 Mar 2020
Distilling Knowledge from Graph Convolutional Networks Yiding Yang Jiayan Qiu Xiuming Zhang Dacheng Tao Xinchao Wang 210 232 0 23 Mar 2020
Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud Weijing Shi Ragunathan R. Rajkumar 3DPC 221 740 0 02 Mar 2020
A Fair Comparison of Graph Neural Networks for Graph Classification Federico Errica Marco Podda D. Bacciu Alessio Micheli FaML 123 447 0 20 Dec 2019
Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networks Difan Zou Ziniu Hu Yewen Wang Song Jiang Yizhou Sun Quanquan Gu GNN 95 283 0 17 Nov 2019
Graph Few-shot Learning via Knowledge Transfer Huaxiu Yao Chuxu Zhang Ying Wei Meng Jiang Suhang Wang Junzhou Huang Nitesh Chawla Z. Li 94 168 0 07 Oct 2019
Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks Minjie Wang Da Zheng Zihao Ye Quan Gan Mufei Li ... Jiaqi Zhao Haotong Zhang Alex Smola Jinyang Li Zheng Zhang AI4CE GNN 286 757 0 03 Sep 2019
Similarity-Preserving Knowledge Distillation Frederick Tung Greg Mori 120 978 0 23 Jul 2019
Graph-based Knowledge Distillation by Multi-head Attention Network Seunghyun Lee B. Song 55 77 0 04 Jul 2019
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding Xiaodong Liu Pengcheng He Weizhu Chen Jianfeng Gao FedML 54 182 0 20 Apr 2019
Correlation Congruence for Knowledge Distillation Baoyun Peng Xiao Jin Jiaheng Liu Shunfeng Zhou Yichao Wu Yu Liu Dongsheng Li Zhaoning Zhang 89 512 0 03 Apr 2019
A Comprehensive Survey on Graph Neural Networks Zonghan Wu Shirui Pan Fengwen Chen Guodong Long Chengqi Zhang Philip S. Yu FaML GNN AI4TS AI4CE 778 8,533 0 03 Jan 2019
Adversarial Attack and Defense on Graph Data: A Survey Lichao Sun Yingtong Dou Carl Yang Ji Wang Yixin Liu Philip S. Yu Lifang He Yangqiu Song GNN AAML 74 281 0 26 Dec 2018
Graph Neural Networks: A Review of Methods and Applications Jie Zhou Ganqu Cui Shengding Hu Zhengyan Zhang Cheng Yang Zhiyuan Liu Lifeng Wang Changcheng Li Maosong Sun AI4CE GNN 1.1K 5,517 0 20 Dec 2018
Relational inductive biases, deep learning, and graph networks Peter W. Battaglia Jessica B. Hamrick V. Bapst Alvaro Sanchez-Gonzalez V. Zambaldi ... Pushmeet Kohli M. Botvinick Oriol Vinyals Yujia Li Razvan Pascanu AI4CE NAI 761 3,121 0 04 Jun 2018
Link Prediction Based on Graph Neural Networks Muhan Zhang Yixin Chen GNN 98 1,937 0 27 Feb 2018
Traffic Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecasting Zhiyong Cui Kristian C. Henrickson Ruimin Ke Ziyuan Pu Yinhai Wang GNN AI4TS 109 750 0 20 Feb 2018
FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling Jie Chen Tengfei Ma Cao Xiao GNN 144 1,513 0 30 Jan 2018
Adaptive Graph Convolutional Neural Networks Ruoyu Li Sheng Wang Feiyun Zhu Junzhou Huang GNN 127 757 0 10 Jan 2018
Graph Distillation for Action Detection with Privileged Modalities Zelun Luo Jun-Ting Hsieh Lu Jiang Juan Carlos Niebles Li Fei-Fei 75 104 0 30 Nov 2017
Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradients A. Ross Finale Doshi-Velez AAML 147 682 0 26 Nov 2017
Non-local Neural Networks Xinyu Wang Ross B. Girshick Abhinav Gupta Kaiming He OffRL 289 8,906 0 21 Nov 2017
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 479 20,164 0 30 Oct 2017
Inductive Representation Learning on Large Graphs William L. Hamilton Z. Ying J. Leskovec 509 15,247 0 07 Jun 2017
Deep Mutual Learning Ying Zhang Tao Xiang Timothy M. Hospedales Huchuan Lu FedML 148 1,653 0 01 Jun 2017
Neural Message Passing for Quantum Chemistry Justin Gilmer S. Schoenholz Patrick F. Riley Oriol Vinyals George E. Dahl 593 7,455 0 04 Apr 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 121 2,581 0 12 Dec 2016
Interaction Networks for Learning about Objects, Relations and Physics Peter W. Battaglia Razvan Pascanu Matthew Lai Danilo Jimenez Rezende Koray Kavukcuoglu AI4CE OCL PINN GNN 541 1,410 0 01 Dec 2016
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering M. Defferrard Xavier Bresson P. Vandergheynst GNN 350 7,655 0 30 Jun 2016
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 308 3,887 0 19 Dec 2014
Spectral Networks and Locally Connected Networks on Graphs Joan Bruna Wojciech Zaremba Arthur Szlam Yann LeCun GNN 220 4,882 0 21 Dec 2013