频域特征融合结合超连接机制的多源传感器遥感数据协同分类
DOI:
CSTR:
作者:
作者单位:

1.哈尔滨理工大学黑龙江省激光光谱技术及应用重点实验室 哈尔滨150080; 2.哈尔滨工业大学超精密光电仪器工程研究所 哈尔滨150001

作者简介:

通讯作者:

中图分类号:

TP391.4TH74

基金项目:

黑龙江省重点研发计划资助项目(JD2023SJ19)资助


Multi-sensor remote sensing data collaborative classification combining frequency-domain feature fusion with hyper-connection mechanism
Author:
Affiliation:

1.Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China; 2.Institute of Ultra-Precision Optoelectronic Instrument Engineering, Ultra-Precision Optoelectronic Instrument Engineering , Harbin Institute of Technology, Harbin 150001, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对高光谱图像(HSI)与激光雷达(LiDAR)、合成孔径雷达(SAR)等多源传感器遥感数据在协同分类中因成像机理与测量特性差异导致的特征提取不充分及协同利用受限问题,本文提出一种结合频域特征融合与超连接机制的跨传感器频域感知融合网络(CFF-Net)。该方法从频率域视角刻画多源观测信息的互补关系,实现异构传感器特征的协同建模与有效融合。在特征提取阶段,构建多维特征感知编码器,通过并行建模高频局部细节信息与低频全局结构信息,实现对不同传感器观测特性的互补表征;在特征协同融合阶段,引入跨传感器超融合模块,将超连接机制与频率自注意力相结合,实现多源传感器特征在频域上的自适应对齐与协同增强,从而提升融合特征的一致性与判别能力。在MUUFL Gulfport(MU)、Houston 2013(HU)和Augsburg(AU)3个公开多源传感器遥感数据集上的实验结果表明,CFF-Net的总体分类精度(OA)分别达到92.23%、93.51%和91.54%,平均精度(AA)分别为92.05%、93.77%和64.81%,均优于所有对比方法。模型参数量仅为0.30 M,浮点运算量为60.55 M,在保持轻量级结构的同时实现了分类性能与计算效率的合理平衡,验证了所提方法在多源传感器遥感数据协同分类中的有效性与适用性。

    Abstract:

    In the joint classification of multi-sensor remote sensing data, such as hyperspectral images (HSI), light detection and ranging (LiDAR), and synthetic aperture radar (SAR), differences in imaging mechanisms and measurement characteristics often lead to insufficient feature extraction and limited collaborative utilization. To address these issues, this paper proposes a cross-sensor frequency-aware fusion network (CFF-Net) that integrates frequency-domain feature fusion with a hyper-connection mechanism. From a frequency-domain perspective, the proposed method characterizes the complementary relationships among multi-source observations, enabling the collaborative modeling and effective fusion of heterogeneous sensor features. In the feature extraction stage, a multi-dimensional feature perception encoder is constructed to jointly model high-frequency local detail information and low-frequency global structural information in parallel, thereby achieving complementary representations of different sensor observation characteristics. In the feature fusion stage, a cross-sensor hyper-fusion module is introduced, combining the hyper-connection mechanism with frequency-based self-attention to realize adaptive alignment and collaborative enhancement of multi-sensor features in the frequency domain, thereby improving the consistency and discriminability of the fused representations. Extensive experiments are conducted on three public multi-sensor remote sensing datasets: MUUFL Gulfport (MU), Houston 2013 (HU), and Augsburg (AU). The results demonstrate that CFF-Net achieves overall accuracy (OA) of 92.23%, 93.51%, and 91.54%, alongside average accuracy (AA) of 92.05%, 93.77%, and 64.81%, respectively, significantly outperforming all compared methods. With only 0.30 M parameters and 60.55 M FLOPs, the proposed method achieves a favorable balance between classification performance and computational efficiency, validating its effectiveness and applicability in multi-sensor remote sensing data collaborative classification.

    参考文献
    相似文献
    引证文献
引用本文

王爱丽,戴诗语,陈寅生,于亮,吴海滨.频域特征融合结合超连接机制的多源传感器遥感数据协同分类[J].仪器仪表学报,2026,47(6):159-172

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-09-02
  • 出版日期:
文章二维码