A Note on Over-Smoothing for Graph Neural Networks

23 June 2020

Papers citing "A Note on Over-Smoothing for Graph Neural Networks"

50 / 58 papers shown

Title
Scalability Matters: Overcoming Challenges in InstructGLM with Similarity-Degree-Based Sampling Hyun Lee Chris Yi Maminur Islam B.D.S. Aritra 35 0 0 02 May 2025
What makes a good feedforward computational graph? Alex Vitvitskyi J. G. Araújo Marc Lackenby Petar Velickovic 87 1 0 10 Feb 2025
A Privacy-Preserving Domain Adversarial Federated learning for multi-site brain functional connectivity analysis Wenjie Qu Likai Wang Kuan-Jui Su Aiying Zhang Hao Zhu Xiaowen Liu Hui Shen Vince D. Calhoun Yuping Wang H. Deng 63 0 0 03 Feb 2025
Resolving Oversmoothing with Opinion Dissensus Keqin Wang Yulong Yang Ishan Saha Christine Allen-Blanchette 62 1 0 31 Jan 2025
Understanding the Effect of GCN Convolutions in Regression Tasks Juntong Chen Johannes Schmidt-Hieber Claire Donnat Olga Klopp GNN 31 0 0 26 Oct 2024
OmniXAS: A Universal Deep-Learning Framework for Materials X-ray Absorption Spectra Shubha R. Kharel Fanchen Meng Xiaohui Qu Matthew R. Carbone Deyu Lu 34 0 0 29 Sep 2024
Preventing Representational Rank Collapse in MPNNs by Splitting the Computational Graph Andreas Roth Franka Bause Nils M. Kriege Thomas Liebig 35 4 0 17 Sep 2024
RIDA: A Robust Attack Framework on Incomplete Graphs Jianke Yu Hanchen Wang Chen Chen Xiaoyang Wang Wenjie Zhang Ying Zhang Ying Zhang Xijuan Liu GNN OOD AAML 48 1 0 25 Jul 2024
Graph Neural Reaction Diffusion Models Moshe Eliasof Eldad Haber Eran Treister DiffM AI4CE 38 2 0 16 Jun 2024
Efficient Topology-aware Data Augmentation for High-Degree Graph Neural Networks Dongrui Fan Xiaoyang Lin Renchi Yang Hongtao Wang 46 2 0 08 Jun 2024
Continuous Product Graph Neural Networks Aref Einizade Fragkiskos D. Malliaros Jhony H. Giraldo 42 1 0 29 May 2024
Bundle Neural Networks for message diffusion on graphs Jacob Bamberger Federico Barbero Xiaowen Dong Michael M. Bronstein 48 1 0 24 May 2024
Three Revisits to Node-Level Graph Anomaly Detection: Outliers, Message Passing and Hyperbolic Neural Networks Jing Gu Dongmian Zou 37 3 0 06 Mar 2024
GNSS Positioning using Cost Function Regulated Multilateration and Graph Neural Networks Amir Jalalirad Davide Belli Bence Major Songwon Jee Himanshu Shah Will Morrison 33 1 0 28 Feb 2024
LightHGNN: Distilling Hypergraph Neural Networks into MLPs for $100\times$ Faster Inference Yifan Feng Yihe Luo Shihui Ying Yue Gao BDL 22 2 0 06 Feb 2024
GRASP: GRAph-Structured Pyramidal Whole Slide Image Representation Ali Khajegili Mirabadi Graham Archibald Amirali Darbandsari A. Contreras-Sanz Ramin Nakhli ... C. Gilks Peter C Black Gang Wang H. Farahani A. Bashashati 32 5 0 06 Feb 2024
Graph Convolutions Enrich the Self-Attention in Transformers! Jeongwhan Choi Hyowon Wi Jayoung Kim Yehjin Shin Kookjin Lee Nathaniel Trask Noseong Park 40 4 0 07 Dec 2023
Dirichlet Energy Enhancement of Graph Neural Networks by Framelet Augmentation Jialin Chen Yuelin Wang Cristian Bodnar Rex Ying Pietro Lio Yu Guang Wang 37 10 0 09 Nov 2023
URLOST: Unsupervised Representation Learning without Stationarity or Topology Zeyu Yun Juexiao Zhang Bruno A. Olshausen Yann LeCun 33 0 0 06 Oct 2023
Information Flow in Graph Neural Networks: A Clinical Triage Use Case Víctor Valls Mykhaylo Zayats Alessandra Pascale 27 1 0 12 Sep 2023
Unifying over-smoothing and over-squashing in graph neural networks: A physics informed approach and beyond Zhiqi Shao Dai Shi Andi Han Yi Guo Qianchuan Zhao Junbin Gao 38 12 0 06 Sep 2023
Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networks Andreas Roth Thomas Liebig 51 13 0 31 Aug 2023
How Curvature Enhance the Adaptation Power of Framelet GCNs Dai Shi Yi Guo Zhiqi Shao Junbin Gao 31 14 0 19 Jul 2023
Supervised Attention Using Homophily in Graph Neural Networks Michail Chatzianastasis Giannis Nikolentzos Michalis Vazirgiannis GNN 21 0 0 11 Jul 2023
A Neural Collapse Perspective on Feature Evolution in Graph Neural Networks Vignesh Kothapalli Tom Tirer Joan Bruna 46 12 0 04 Jul 2023
Centered Self-Attention Layers Ameen Ali Tomer Galanti Lior Wolf 51 6 0 02 Jun 2023
A Fractional Graph Laplacian Approach to Oversmoothing Sohir Maskey Raffaele Paolino Aras Bacho Gitta Kutyniok 39 32 0 22 May 2023
Dynamic Causal Explanation Based Diffusion-Variational Graph Neural Network for Spatio-temporal Forecasting G. Liang Prayag Tiwari Sławomir Nowaczyk Stefan Byttner F. Alonso-Fernandez DiffM 44 13 0 16 May 2023
Dynamic Graph Representation Learning with Neural Networks: A Survey Leshanshui Yang Sébastien Adam Clément Chatelain AI4TS AI4CE 39 14 0 12 Apr 2023
A Survey on Oversmoothing in Graph Neural Networks T. Konstantin Rusch Michael M. Bronstein Siddhartha Mishra 43 188 0 20 Mar 2023
Expediting Distributed DNN Training with Device Topology-Aware Graph Deployment Shiwei Zhang Xiaodong Yi Lansong Diao Chuan Wu Siyu Wang W. Lin GNN 22 5 0 13 Feb 2023
On the Connection Between MPNN and Graph Transformer Chen Cai Truong-Son Hy Rose Yu Yusu Wang 46 53 0 27 Jan 2023
Adaptive Depth Graph Attention Networks Jingbo Zhou Yixuan Du Ruqiong Zhang Rui Zhang GNN 41 1 0 16 Jan 2023
Revisiting Over-smoothing and Over-squashing Using Ollivier-Ricci Curvature K. Nguyen Hieu Nong T. Nguyen Nhat Ho Khuong N. Nguyen Vinh Phu Nguyen 32 64 0 28 Nov 2022
Comprehensive Analysis of Over-smoothing in Graph Neural Networks from Markov Chains Perspective Weichen Zhao Chenguang Wang Congying Han Tiande Guo 33 1 0 12 Nov 2022
Old can be Gold: Better Gradient Flow can Make Vanilla-GCNs Great Again Ajay Jaiswal Peihao Wang Tianlong Chen Justin F. Rousseau Ying Ding Zhangyang Wang 37 10 0 14 Oct 2022
Generalized energy and gradient flow via graph framelets Andi Han Dai Shi Zhiqi Shao Junbin Gao 78 13 0 08 Oct 2022
From Local to Global: Spectral-Inspired Graph Neural Networks Ningyuan Huang Soledad Villar Carey E. Priebe Da Zheng Cheng-Fu Huang Lin F. Yang Vladimir Braverman 25 14 0 24 Sep 2022
FedEgo: Privacy-preserving Personalized Federated Graph Learning with Ego-graphs Taolin Zhang Chuan Chen Yaomin Chang Lin Shu Zibin Zheng FedML 31 14 0 29 Aug 2022
What Does the Gradient Tell When Attacking the Graph Structure Zihan Liu Ge Wang Yun Luo Stan Z. Li AAML 27 2 0 26 Aug 2022
Tuning the Geometry of Graph Neural Networks Sowon Jeong Claire Donnat AI4CE 53 1 0 12 Jul 2022
Pure Transformers are Powerful Graph Learners Jinwoo Kim Tien Dat Nguyen Seonwoo Min Sungjun Cho Moontae Lee Honglak Lee Seunghoon Hong 43 191 0 06 Jul 2022
ACMP: Allen-Cahn Message Passing for Graph Neural Networks with Particle Phase Transition Yuelin Wang Kai Yi Xinliang Liu Yu Guang Wang Shi Jin 29 33 0 11 Jun 2022
Model Degradation Hinders Deep Graph Neural Networks Wentao Zhang Zeang Sheng Ziqi Yin Yuezihan Jiang Yikuan Xia Jun Gao Zhi-Xin Yang Tengjiao Wang GNN AI4CE 31 40 0 09 Jun 2022
VRAG: Region Attention Graphs for Content-Based Video Retrieval K. Ng Ser-Nam Lim G. Lee 35 4 0 18 May 2022
NC-DRE: Leveraging Non-entity Clue Information for Document-level Relation Extraction Li Zhang Yidong Cheng 13 2 0 01 Apr 2022
Preventing Over-Smoothing for Hypergraph Neural Networks Guan-Wun Chen Jiying Zhang Xi Xiao Yang Li 23 22 0 31 Mar 2022
Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice Peihao Wang Wenqing Zheng Tianlong Chen Zhangyang Wang ViT 33 127 0 09 Mar 2022
Equilibrium Aggregation: Encoding Sets via Optimization Sergey Bartunov F. Fuchs Timothy Lillicrap 34 7 0 25 Feb 2022
Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs Cristian Bodnar Francesco Di Giovanni B. Chamberlain Pietro Lio Michael M. Bronstein 37 171 0 09 Feb 2022