基于特征层次递进融合的轻量级图像超分辨率网络
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:


Lightweight Image Super-resolution Network Based on Progressive Fusion of Hierarchical Feature
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    近年来, 随着深度学习技术的发展, 卷积神经网络(convolutional neural network, CNN)和Transformer在图像超分辨率(super-resolution, SR)领域取得了显著的进展. 但是, 对于图像全局特征的提取, 过去的方法大多采用的是堆叠单个算子重复计算来逐步扩大感受野的方式. 为了更好地利用全局信息, 提出了对局部、区域和全局特征进行显式建模. 具体来说, 通过通道注意增强卷积、基于划分窗口的Transformer和CNN的双分支并行架构、标准的Transformer和划分窗口的Transformer双分支并行架构, 以一种层次递进的方式对图像的局部信息、区域与局部信息、全局与区域信息进行提取和融合. 此外, 设计了一种层次特征融合方式来对CNN分支提取到的局部信息和划分窗口的Transformer提取到的区域信息进行特征融合. 大量的实验表明, 所提网络在轻量级SR领域实现了更好的结果. 例如, 在Manga109数据集的4倍放大实验中, 该网络的峰值信噪比(PSNR)相较于SwinIR提升了0. 51 dB.

    Abstract:

    In recent years, with the development of deep learning techniques, convolutional neural network (CNN) and Transformers have made significant progress in image super-resolution. However, for the extraction of global features of an image, it is common to stack individual operators and repeat the computation to gradually expand the receptive field. To better utilize global information, this study proposes that local, regional, and global features should be explicitly modeled. Specifically, local information, regional-local information, and global-regional information of an image are extracted and fused hierarchically and progressively through channel attention-enhanced convolution, a dual-branch parallel architecture consisting of a window-based Transformer and CNN, and a dual-branch parallel architecture consisting of a standard Transformer and a window-based Transformer. In addition, a hierarchical feature fusion method is designed to fuse the local information extracted from the CNN branch and the regional information extracted from the window-based Transformer. Extensive experiments show that the proposed network achieves better results in lightweight SR. For example, in the 4× upscaling experiments on the Manga109 dataset, the peak signal-to-noise ratio (PSNR) of the proposed network is improved by 0.51 dB compared to SwinIR.

    参考文献
    相似文献
    引证文献
引用本文

张豪,马冀,袁江.基于特征层次递进融合的轻量级图像超分辨率网络.计算机系统应用,,():1-10

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-06-05
  • 最后修改日期:2024-06-28
  • 录用日期:
  • 在线发布日期: 2024-11-15
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京海淀区中关村南四街4号 中科院软件园区 7号楼305房间,邮政编码:100190
电话:010-62661041 传真: Email:csa (a) iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号