Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillation

17 October 2021

Papers citing "Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillation"

46 / 46 papers shown

Title
Efficient Traffic Prediction Through Spatio-Temporal Distillation Qianru Zhang Xinyi Gao Haixin Wang Siu-Ming Yiu Hongzhi Yin AI4TS 63 2 0 15 Jan 2025
Efficient Link Prediction via GNN Layers Induced by Negative Sampling Yuxin Wang Xiannian Hu Quan Gan Xuanjing Huang Xipeng Qiu David Wipf 93 4 0 31 Dec 2024
Humans as a Calibration Pattern: Dynamic 3D Scene Reconstruction from Unsynchronized and Uncalibrated Videos Changwoon Choi Jeongjun Kim Geonho Cha Minkwan Kim Dongyoon Wee Young Min Kim 3DH 85 2 0 26 Dec 2024
Spatial-Temporal Knowledge Distillation for Takeaway Recommendation Shuyuan Zhao Wei Chen Boyan Shi Liyong Zhou Shuohao Lin Huaiyu Wan 117 0 0 21 Dec 2024
Sparse Decomposition of Graph Neural Networks Yaochen Hu Mai Zeng Ge Zhang Pavel Rumiantsev Liheng Ma Yingxue Zhang Mark Coates 62 0 0 25 Oct 2024
Hypergraph-MLP: Learning on Hypergraphs without Message Passing Bohan Tang Siheng Chen Xiaowen Dong 48 6 0 15 Dec 2023
Graph Condensation for Graph Neural Networks Wei Jin Lingxiao Zhao Shichang Zhang Yozen Liu Jiliang Tang Neil Shah DD AI4CE 67 154 0 14 Oct 2021
Training Graph Neural Networks with 1000 Layers Guohao Li Matthias Muller Guohao Li V. Koltun GNN AI4CE 63 238 0 14 Jun 2021
Graph-MLP: Node Classification without Message Passing in Graph Yang Hu Haoxuan You Zhecan Wang Zhicheng Wang Erjin Zhou Yue Gao 74 110 0 08 Jun 2021
Pay Attention to MLPs Hanxiao Liu Zihang Dai David R. So Quoc V. Le AI4CE 77 657 0 17 May 2021
Graph-Free Knowledge Distillation for Graph Neural Networks Xiang Deng Zhongfei Zhang 34 66 0 16 May 2021
Accelerating Large Scale Real-Time GNN Inference using Channel Pruning Hongkuan Zhou Ajitesh Srivastava Hanqing Zeng Rajgopal Kannan Viktor Prasanna GNN 23 66 0 10 May 2021
ResMLP: Feedforward networks for image classification with data-efficient training Hugo Touvron Piotr Bojanowski Mathilde Caron Matthieu Cord Alaaeldin El-Nouby ... Gautier Izacard Armand Joulin Gabriel Synnaeve Jakob Verbeek Hervé Jégou VLM 49 657 0 07 May 2021
Do You Even Need Attention? A Stack of Feed-Forward Layers Does Surprisingly Well on ImageNet Luke Melas-Kyriazi ViT 18 102 0 06 May 2021
RepMLP: Re-parameterizing Convolutions into Fully-connected Layers for Image Recognition Xiaohan Ding Chunlong Xia Xinming Zhang Xiaojie Chu Jungong Han Guiguang Ding 34 93 0 05 May 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 369 2,638 0 04 May 2021
New Benchmarks for Learning on Non-Homophilous Graphs Derek Lim Xiuyu Li Felix Hohne Ser-Nam Lim 48 101 0 03 Apr 2021
Extract the Knowledge of Graph Neural Networks and Go Beyond it: An Effective Knowledge Distillation Framework Cheng Yang Jiawei Liu C. Shi 34 127 0 04 Mar 2021
Boost then Convolve: Gradient Boosting Meets Graph Neural Networks Sergei Ivanov Liudmila Prokhorenkova AI4CE 60 52 0 21 Jan 2021
Combining Label Propagation and Simple Models Out-performs Graph Neural Networks Qian Huang Horace He Abhay Singh Ser-Nam Lim Austin R. Benson 52 283 0 27 Oct 2020
Learned Low Precision Graph Neural Networks Yiren Zhao Duo Wang Daniel Bates Robert D. Mullins M. Jamnik Pietro Lio GNN 39 36 0 19 Sep 2020
GraphSAIL: Graph Structure Aware Incremental Learning for Recommender Systems Yishi Xu Yingxue Zhang Wei Guo Huifeng Guo Ruiming Tang Mark Coates CLL 17 80 0 25 Aug 2020
Degree-Quant: Quantization-Aware Training for Graph Neural Networks Shyam A. Tailor Javier Fernandez-Marques Nicholas D. Lane GNN MQ 36 142 0 11 Aug 2020
Simple and Deep Graph Convolutional Networks Ming Chen Zhewei Wei Zengfeng Huang Bolin Ding Yaliang Li GNN 70 1,466 0 04 Jul 2020
Open Graph Benchmark: Datasets for Machine Learning on Graphs Weihua Hu Matthias Fey Marinka Zitnik Yuxiao Dong Hongyu Ren Bowen Liu Michele Catasta J. Leskovec 140 2,687 0 02 May 2020
SIGN: Scalable Inception Graph Neural Networks Fabrizio Frasca Emanuele Rossi D. Eynard B. Chamberlain M. Bronstein Federico Monti GNN 46 394 0 23 Apr 2020
Distilling Knowledge from Graph Convolutional Networks Yiding Yang Jiayan Qiu Xiuming Zhang Dacheng Tao Xinchao Wang 190 228 0 23 Mar 2020
Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator Zhenyue Qin Dongwoo Kim Tom Gedeon SSL 18 50 0 25 Nov 2019
Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networks Difan Zou Ziniu Hu Yewen Wang Song Jiang Yizhou Sun Quanquan Gu GNN 53 282 0 17 Nov 2019
Spectral Clustering with Graph Neural Networks for Graph Pooling F. Bianchi Daniele Grattarola Cesare Alippi GNN 34 40 0 30 Jun 2019
Joint embedding of structure and features via graph convolutional networks Sébastien Lerique Jacob Levy Abitbol M. Karsai GNN 27 30 0 21 May 2019
DeepGCNs: Can GCNs Go as Deep as CNNs? Ge Li Matthias Muller Ali K. Thabet Guohao Li 3DPC GNN 87 1,333 0 07 Apr 2019
Simplifying Graph Convolutional Networks Felix Wu Tianyi Zhang Amauri Souza Christopher Fifty Tao Yu Kilian Q. Weinberger GNN 129 3,149 0 19 Feb 2019
Predict then Propagate: Graph Neural Networks meet Personalized PageRank Johannes Klicpera Aleksandar Bojchevski Stephan Günnemann GNN 161 1,674 0 14 Oct 2018
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 96 7,554 0 01 Oct 2018
FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling Jie Chen Tengfei Ma Cao Xiao GNN 79 1,512 0 30 Jan 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 225 19,902 0 30 Oct 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 230 129,831 0 12 Jun 2017
Inductive Representation Learning on Large Graphs William L. Hamilton Z. Ying J. Leskovec 273 15,066 0 07 Jun 2017
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 310 28,795 0 09 Sep 2016
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering M. Defferrard Xavier Bresson P. Vandergheynst GNN 184 7,622 0 30 Jun 2016
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 145 6,628 0 08 Jun 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 69 19,448 0 09 Mar 2015
Deep Learning with Limited Numerical Precision Suyog Gupta A. Agrawal K. Gopalakrishnan P. Narayanan HAI 57 2,041 0 09 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 262 149,474 0 22 Dec 2014
Spectral Networks and Locally Connected Networks on Graphs Joan Bruna Wojciech Zaremba Arthur Szlam Yann LeCun GNN 61 4,856 0 21 Dec 2013