高频信息强化的双分支高光谱图像超分辨率网络
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

青岛市科技惠民示范专项(23-2-8-smjk-20-nsh); 山东省产教融合研究生联合培养示范基地项目(2020-19)


High-frequency Enhanced Dual-branch Hyperspectral Image Super-resolution Network
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    高光谱图像(hyperspectral image, HSI)的窄光谱波段为许多视觉任务提供了丰富信息, 但也给特征提取带来了挑战. 尽管许多研究者提出了各种深度学习方法, 但尚未充分结合这些架构的优势. 因此, 本文提出了一种基于高频信息强化的双分支高光谱图像超分辨率网络(HFEDB-Net), 将卷积神经网络(convolutional neural network, CNN)的图像空间特征提取优势与Transformer的自适应能力和长距离依赖提取优势相结合, 有效地提取了HSI的空间和光谱信息. HFEDB-Net由高频信息强化分支和主干分支组成. 在高频信息强化分支中, 通过拉普拉斯金字塔提取低分辨率和高分辨率HSI的高频信息, 并将结果作为高频分支的输入和标签, 采用光谱强化Transformer来作为该分支的方法. 在主干分支中, 使用结合通道注意力的CNN充分提取空间特征和光谱信息. 最后将两个分支的结果通过CNN进行结合以得到最终的重建图像. 此外, 采用多头注意力和多尺度策略分别改进了Transformer的注意力机制和编码器层, 以更好地提取HSI的空间和光谱信息. 实验结果表明, HFEDB-Net在两个公开数据集上的定量评价指标和视觉效果上优于当前主流方法.

    Abstract:

    The narrow spectral bands of hyperspectral images (HSI) provide rich information for many visual tasks, but also pose challenges for feature extraction. Despite various deep learning methods proposed by researchers, the advantages of these architectures are not fully combined. Therefore, this study proposes a high-frequency enhanced dual-branch hyperspectral image super-resolution network (HFEDB-Net) that effectively extracts spatial and spectral information of HSI by integrating the image spatial feature extraction advantage of convolutional neural network (CNN) with the adaptive capability and long-distance dependency extraction advantage of Transformers. HFEDB-Net consists of a high-frequency information enhancement branch and a backbone branch. In the high-frequency information enhancement branch, the high-frequency information of low-resolution and high-resolution HSI is extracted by using Laplacian pyramids, and the results serve as the input and label for the high-frequency branch. A spectral-enhanced Transformer is employed as the feature extraction method for this branch. In the backbone branch, a CNN with channel attention is utilized to extract spatial features and spectral information comprehensively. Finally, the results from both branches are combined through CNN to obtain the final reconstructed image. Additionally, the attention mechanism and encoder layers of the Transformer are respectively improved by using multi-head attention and multi-scale strategies to better extract spatial and spectral information from HSI. Experimental results demonstrate that HFEDB-Net outperforms current state-of-the-art methods in terms of quantitative evaluation metrics and visual effects on two public datasets.

    参考文献
    相似文献
    引证文献
引用本文

侯钧译,杨锦,边太成,朱习军.高频信息强化的双分支高光谱图像超分辨率网络.计算机系统应用,2024,33(10):217-227

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-04-03
  • 最后修改日期:2024-04-29
  • 录用日期:
  • 在线发布日期: 2024-08-28
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京海淀区中关村南四街4号 中科院软件园区 7号楼305房间,邮政编码:100190
电话:010-62661041 传真: Email:csa (a) iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号