跨尺度混合注意力的遥感图像超分辨率重建  

Super-resolution Reconstruction of Remote Sensing Images with Cross-scale Hybrid Attention

作　　者：肖振久[1] 苏婷 曲海成[1] 翟宇琦 XIAO Zhen-Jiu;SU Ting;QU Hai-Cheng;ZHAI Yu-Qi(Software College,Liaoning Technical University,Huludao 125105,China)

机构地区：[1]辽宁工程技术大学软件学院,葫芦岛125105

出　　处：《计算机系统应用》2024年第6期153-160,共8页Computer Systems & Applications

基　　金：辽宁省高等学校基本科研项目(LJKMZ20220699);辽宁工程技术大学学科创新团队(LNTU20TD-23)。

摘　　要：为了解决现有遥感图像超分辨率重建模型对长期特征相似性和多尺度特征相关性关注不足的问题,提出了一种基于跨尺度混合注意力机制的遥感图像超分辨率重建算法.首先提出了一个全局层注意力机制(global layer attention,GLA),利用层注意力机制加权融合不同层级的全局特征,建模低分辨率与高分辨率图像特征间的长期依赖关系.同时,设计了跨尺度局部注意力机制(cross-scale local attention,CSLA),在多尺度的低分辨率特征图中寻找与高分辨率图像匹配的局部信息补丁,并融合不同尺度的补丁特征,以优化模型对图像细节信息的恢复能力.最后,提出一种局部信息感知损失函数来指导图像的重建过程,进一步提高了重建图像的视觉质量和细节保留能力.在UC-Merced数据集上的实验结果表明,本文方法在3种放大倍数下的平均PSNR/SSIM优于大多数主流方法,并在视觉效果方面展现出更高的质量和更好的细节保留能力.To address the inadequacy of existing remote sensing image super-resolution reconstruction models in longterm feature similarity and multi-scale feature relevance,this study proposes a novel remote sensing image superresolution reconstruction algorithm based on a cross-scale hybrid attention mechanism.Initially,the study introduces a global layer attention(GLA) mechanism and employs layer-wise attention to weight and merge global features across different levels,thereby modeling the extended dependency between low-resolution and high-resolution image features.Concurrently,it designs a cross-scale local attention(CSLA) mechanism to identify and integrate local information patches in multi-scale low-resolution feature maps that correspond with high-resolution images,enhancing the model's ability to restore image details.Finally,the study proposes a local information-aware loss function to guide the image reconstruction process,further improving the visual quality and detail preservation of the reconstructed images.Experiments on UC-Merced datasets demonstrate that the proposed method outperforms most mainstream methods in terms of average PSNR/SSIM across three magnification factors and exhibits superior quality and detail preservation in visual results.

关 键 词：遥感图像 超分辨率重建 多尺度特征融合 注意力机制 特征相似性 

分 类 号：TP751[自动化与计算机技术—检测技术与自动化装置]