ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2502.11394
31
0
v1v2 (latest)

Oversmoothing as Loss of Sign: Towards Structural Balance in Graph Neural Networks

17 February 2025
Jiaqi Wang
Xinyi Wu
James Cheng
Yifei Wang
ArXiv (abs)PDFHTML
Main:9 Pages
13 Figures
Bibliography:3 Pages
16 Tables
Appendix:18 Pages
Abstract

Oversmoothing is a common issue in graph neural networks (GNNs), where node representations become excessively homogeneous as the number of layers increases, resulting in degraded performance. Various strategies have been proposed to combat oversmoothing in practice, yet they are based on different heuristics and lack a unified understanding of their inherent mechanisms. In this paper, we show that three major classes of anti-oversmoothing techniques can be mathematically interpreted as message passing over signed graphs comprising both positive and negative edges. By analyzing the asymptotic behavior of signed graph propagation, we demonstrate that negative edges can repel nodes to a certain extent, providing deeper insights into how these methods mitigate oversmoothing. Furthermore, our results suggest that the structural balance of a signed graph-where positive edges exist only within clusters and negative edges appear only between clusters-is crucial for clustering node representations in the long term through signed graph propagation. Motivated by these observations, we propose a solution to mitigate oversmoothing with theoretical guarantees-Structural Balance Propagation (SBP), by incorporating label and feature information to create a structurally balanced graph for message-passing. Experiments on nine datasets against twelve baselines demonstrate the effectiveness of our method, highlighting the value of our signed graph perspective.

View on arXiv
@article{wang2025_2502.11394,
  title={ A Signed Graph Approach to Understanding and Mitigating Oversmoothing in GNNs },
  author={ Jiaqi Wang and Xinyi Wu and James Cheng and Yifei Wang },
  journal={arXiv preprint arXiv:2502.11394},
  year={ 2025 }
}
Comments on this paper