|国家预印本平台
首页|PAD: Phase-Amplitude Decoupling Fusion for Multi-Modal Land Cover Classification

PAD: Phase-Amplitude Decoupling Fusion for Multi-Modal Land Cover Classification

PAD: Phase-Amplitude Decoupling Fusion for Multi-Modal Land Cover Classification

来源:Arxiv_logoArxiv
英文摘要

The fusion of Synthetic Aperture Radar (SAR) and RGB imagery for land cover classification remains challenging due to modality heterogeneity and underutilized spectral complementarity. Existing methods often fail to decouple shared structural features from modality-complementary radiometric attributes, causing feature conflicts and information loss. To address this, we propose Phase-Amplitude Decoupling (PAD), a frequency-aware framework that separates phase (modality-shared) and amplitude (modality-complementary) components in the Fourier domain, thus reinforcing shared structures while preserving complementary characteristics to improve fusion quality. Unlike prior approaches that overlook the distinct physical properties encoded in frequency spectra, PAD is the first to introduce explicit amplitude-phase decoupling for multi-modal fusion. Specifically, PAD comprises two key components: 1) Phase Spectrum Correction (PSC), which aligns cross-modal phase features via convolution-guided scaling to enhance geometric consistency; and 2) Amplitude Spectrum Fusion (ASF), which dynamically integrates high-frequency and low-frequency patterns using frequency-adaptive multilayer perceptrons, leveraging SAR's morphological sensitivity and RGB's spectral richness. Extensive experiments on WHU-OPT-SAR and DDHR-SK datasets demonstrate state-of-the-art performance. Our work establishes a new paradigm for physics-aware multi-modal fusion in remote sensing. The code will be available at https://github.com/RanFeng2/PAD.

Bihan Wen、Huiling Zheng、Xian Zhong、Bin Liu、Yi Xiao、Xiaofeng Li

测绘学

Bihan Wen,Huiling Zheng,Xian Zhong,Bin Liu,Yi Xiao,Xiaofeng Li.PAD: Phase-Amplitude Decoupling Fusion for Multi-Modal Land Cover Classification[EB/OL].(2025-07-03)[2025-07-16].https://arxiv.org/abs/2504.19136.点此复制

评论