Learn Before
Concept

Over-Smoothing as a Low-Pass Convolutional Filter

Suppose we have a simplified Graph Neural Network (GNN): H(k)=AsymH(k1)W(k)=AsymkXW\mathbf{H}^{(k)} = \mathbf{A}_{sym} \mathbf{H}^{(k-1)} \mathbf{W}^{(k)} = \mathbf{A}_{sym}^k \mathbf{X} \mathbf{W} If kk is large enough such that we reach a fixed point, then we will have AsymHk=Hk\mathbf{A}_{sym} \mathbf{H}^k = \mathbf{H}^k. At this fixed point, all nodes will converge to be defined by the dominant eigenvector of Asym\mathbf{A}_{sym}. Therefore, stacking many rounds of message passing acts as a low-pass convolutional filter, causing all node representations to become identical and uninformative. This phenomenon is known as over-smoothing.

0

1

Updated 2026-06-19

Tags

Deep Learning (in Machine learning)

Data Science

Computing Sciences