|国家预印本平台
首页|Beyond Node Attention: Multi-Scale Harmonic Encoding for Feature-Wise Graph Message Passing

Beyond Node Attention: Multi-Scale Harmonic Encoding for Feature-Wise Graph Message Passing

Beyond Node Attention: Multi-Scale Harmonic Encoding for Feature-Wise Graph Message Passing

来源:Arxiv_logoArxiv
英文摘要

Conventional Graph Neural Networks (GNNs) aggregate neighbor embeddings as holistic vectors, lacking the ability to identify fine-grained, direction-specific feature relevance. We propose MSH-GNN (Multi-Scale Harmonic Graph Neural Network), a novel architecture that performs feature-wise adaptive message passing through node-specific harmonic projections. For each node, MSH-GNN dynamically projects neighbor features onto frequency-sensitive directions determined by the target node's own representation. These projections are further modulated using learnable sinusoidal encodings at multiple frequencies, enabling the model to capture both smooth and oscillatory structural patterns across scales. A frequency-aware attention pooling mechanism is introduced to emphasize spectrally and structurally salient nodes during readout. Theoretically, we prove that MSH-GNN approximates shift-invariant kernels and matches the expressive power of the 1-Weisfeiler-Lehman (1-WL) test. Empirically, MSH-GNN consistently outperforms state-of-the-art models on a wide range of graph and node classification tasks. Furthermore, in challenging classification settings involving joint variations in graph topology and spectral frequency, MSH-GNN excels at capturing structural asymmetries and high-frequency modulations, enabling more accurate graph discrimination.

Longlong Li、Cunquan Qu、Guanghui Wang

计算技术、计算机技术

Longlong Li,Cunquan Qu,Guanghui Wang.Beyond Node Attention: Multi-Scale Harmonic Encoding for Feature-Wise Graph Message Passing[EB/OL].(2025-05-20)[2025-06-07].https://arxiv.org/abs/2505.15015.点此复制

评论