Understanding Oversmoothing in Diffusion-Based GNNs From the Perspective of Operator Semigroup Theory

23 February 2024

Congying Han

Tianshu Yu

Papers citing "Understanding Oversmoothing in Diffusion-Based GNNs From the Perspective of Operator Semigroup Theory"

32 / 32 papers shown

Title
Unleashing the Potential of Fractional Calculus in Graph Neural Networks with FROND Qiyu Kang Kai Zhao Qinxu Ding Feng Ji Xuhao Li Wenfei Liang Yang Song Wee Peng Tay 117 9 0 26 Apr 2024
Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization Kaixuan Chen Shunyu Liu Tongtian Zhu Tongya Zheng Haofei Zhang Zunlei Feng Jingwen Ye Mingli Song 68 14 0 31 May 2023
A Fractional Graph Laplacian Approach to Oversmoothing Sohir Maskey Raffaele Paolino Aras Bacho Gitta Kutyniok 90 35 0 22 May 2023
DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusion Qitian Wu Chenxiao Yang Wen-Long Zhao Yixuan He David Wipf Junchi Yan DiffM 62 87 0 23 Jan 2023
TIDE: Time Derivative Diffusion for Deep Learning on Graphs M. Behmanesh Maximilian Krahn M. Ovsjanikov DiffM GNN 36 9 0 05 Dec 2022
GREAD: Graph Neural Reaction-Diffusion Networks Jeongwhan Choi Seoyoung Hong Noseong Park Sung-Bae Cho DiffM GNN 45 28 0 25 Nov 2022
Comprehensive Analysis of Over-smoothing in Graph Neural Networks from Markov Chains Perspective Weichen Zhao Chenguang Wang Congying Han Tiande Guo 52 1 0 12 Nov 2022
Gradient Gating for Deep Multi-Rate Learning on Graphs T. Konstantin Rusch B. Chamberlain Michael W. Mahoney Michael M. Bronstein Siddhartha Mishra 93 58 0 02 Oct 2022
On the Robustness of Graph Neural Diffusion to Topology Perturbations Yang Song Qiyu Kang Sijie Wang Zhao Kai Wee Peng Tay DiffM AAML 88 36 0 16 Sep 2022
Optimization-Induced Graph Implicit Nonlinear Diffusion Qi Chen Yifei Wang Yisen Wang Jiansheng Yang Zhouchen Lin DiffM 88 32 0 29 Jun 2022
ACMP: Allen-Cahn Message Passing for Graph Neural Networks with Particle Phase Transition Yuelin Wang Kai Yi Xinliang Liu Yu Guang Wang Shi Jin 51 35 0 11 Jun 2022
Protein Representation Learning by Geometric Structure Pretraining Zuobai Zhang Minghao Xu Arian R. Jamasb Vijil Chenthamarakshan A. Lozano Payel Das Jian Tang SSL 39 224 0 11 Mar 2022
Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs Cristian Bodnar Francesco Di Giovanni B. Chamberlain Pietro Lio Michael M. Bronstein 67 177 0 09 Feb 2022
Graph-Coupled Oscillator Networks T. Konstantin Rusch B. Chamberlain J. Rowbottom S. Mishra M. Bronstein 83 112 0 04 Feb 2022
$p$ -Laplacian Based Graph Neural Networks Guoji Fu P. Zhao Yatao Bian 44 45 0 14 Nov 2021
Beltrami Flow and Neural Diffusion on Graphs B. Chamberlain J. Rowbottom D. Eynard Francesco Di Giovanni Xiaowen Dong M. Bronstein AI4CE 57 83 0 18 Oct 2021
PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equations Moshe Eliasof E. Haber Eran Treister GNN AI4CE 83 126 0 04 Aug 2021
GRAND: Graph Neural Diffusion B. Chamberlain J. Rowbottom Maria I. Gorinova Stefan Webb Emanuele Rossi M. Bronstein GNN 109 265 0 21 Jun 2021
Simple and Deep Graph Convolutional Networks Ming Chen Zhewei Wei Zengfeng Huang Bolin Ding Yaliang Li GNN 108 1,483 0 04 Jul 2020
Geom-GCN: Geometric Graph Convolutional Networks Hongbin Pei Bingzhen Wei Kevin Chen-Chuan Chang Yu Lei Bo Yang GNN 312 1,116 0 13 Feb 2020
Continuous Graph Neural Networks Louis-Pascal Xhonneux Meng Qu Jian Tang GNN 84 153 0 02 Dec 2019
Multi-scale Attributed Node Embedding Benedek Rozemberczki Carl Allen Rik Sarkar GNN 252 857 0 28 Sep 2019
PairNorm: Tackling Oversmoothing in GNNs Lingxiao Zhao Leman Akoglu 65 508 0 26 Sep 2019
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 373 5,081 0 19 Jun 2018
Representation Learning on Graphs with Jumping Knowledge Networks Keyulu Xu Chengtao Li Yonglong Tian Tomohiro Sonobe Ken-ichi Kawarabayashi Stefanie Jegelka GNN 490 1,977 0 09 Jun 2018
Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning Qimai Li Zhichao Han Xiao-Ming Wu GNN SSL 180 2,820 0 22 Jan 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 438 20,089 0 30 Oct 2017
Inductive Representation Learning on Large Graphs William L. Hamilton Z. Ying J. Leskovec 464 15,179 0 07 Jun 2017
Neural Message Passing for Quantum Chemistry Justin Gilmer S. Schoenholz Patrick F. Riley Oriol Vinyals George E. Dahl 547 7,431 0 04 Apr 2017
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 589 28,999 0 09 Sep 2016
Revisiting Semi-Supervised Learning with Graph Embeddings Zhilin Yang William W. Cohen Ruslan Salakhutdinov GNN SSL 162 2,088 0 29 Mar 2016
Image-based Recommendations on Styles and Substitutes Julian McAuley C. Targett Javen Qinfeng Shi Anton Van Den Hengel 121 2,396 0 15 Jun 2015