基于双通道多尺度特征提取和注意力的SAR与多光谱图像融合  

SAR and Multispectral Image Fusion Based on Dual-channel Multi-scale Feature Extraction and Attention

作　　者：种法亭 董张玉[1,2,3] 杨学志 曾庆旺 CHONG Fating;DONG Zhangyu;YANG Xuezhi;ZENG Qingwang(College of Computer and Information,Hefei University of Technology,Hefei 230031,China;Anhui Province Key Laboratory of Industry Safety and Emergency Technology,Hefei 230031,China;Anhui Province Laboratory of Intelligent Interconnection System,Hefei 230031,China)

机构地区：[1]合肥工业大学计算机与信息学院,安徽合肥230031 [2]工业安全与应急技术安徽省重点实验室,安徽合肥230031 [3]智能互联系统安徽省实验室,安徽合肥230031

出　　处：《红外技术》2024年第1期61-73,共13页Infrared Technology

基　　金：安徽省重点研究与开发计划项目(202004a07020030);安徽省自然科学基金项目(2108085MF233);中央高校基本科研业务费专项(JZ2021HGTB0111)。

摘　　要：图像融合的根本任务是提取图像特征,由于合成孔径雷达(Synthetic Aperture Radar,SAR)图像和多光谱(Multi Spectral,MS)图像存在通道差异,针对现有算法难以充分提取和利用SAR图像的高频细节信息和多光谱图像的低频光谱信息,融合图像存在细节丢失和光谱失真问题。本文提出了一种基于双通道多尺度特征提取和混合注意力的图像融合算法。首先采用双通道网络提取SAR和多光谱图像的多尺度高频细节特征和低频光谱特征,并连续使用不同空洞率的扩张卷积扩大感受野。然后将提取的特征映射到混合注意力模块中进行特征增强,再将这些增强特征与上采样的多光谱图像叠加。同时构建了基于光谱角度距离的损失函数,可以进一步缓解细节丢失和光谱失真。最后通过解码网络重建图像,得到高分辨率的融合图像。实验结果表明,本文算法达到了领先水平,并且融合图像在细节和光谱上保持了较好的平衡。The fundamental task of image fusion is to extract image features.Because of the channel differences between synthetic aperture radar(SAR)images and multispectral(MS)images,existing algorithms have difficulty in fully extracting and utilizing the high-frequency detail information of SAR images and low-frequency spectral information of multispectral images,and the fused images have problems with detail loss and spectral distortion.In this study,an image fusion algorithm based on dual-channel multiscale feature extraction and hybrid attention is proposed.First,a dual-channel network is used to extract multi-scale high-frequency detail features and low-frequency spectral features of SAR and multispectral images,and successively expand the perceptual field using dilated convolution with different void rates.The extracted features are then mapped to the hybrid attention module for feature enhancement,and these enhanced features are superimposed on the upsampled multispectral images.A loss function based on the spectral angular distance was also constructed,which could further alleviate the problems of detail loss and spectral distortion.Finally,the image is reconstructed using a decoding network to obtain a high-resolution fused image.The experimental results show that the proposed algorithm achieves the best performance and that the fused image maintains a good balance of details and spectra.

关 键 词：SAR图像融合 扩张卷积 多尺度提取 残差网络 注意力机制 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]