基于多级特征补偿的遥感图像时空融合方法  

Spatiotemporal fusion of remote sensing images based on multi-level feature compensation

作　　者：刘文杰 李雨珈 白梦浩 张莉萍 雷大江[1,2] LIU Wenjie;LI Yujia;BAI Menghao;ZHANG Liping;LEI Dajiang(School of Computer,Chongqing University of Posts and Telecommunications,Chongqing 400065,China;Chongqing Key Laboratory of Image Cognition,Chongqing University of Posts and Telecommunications,Chongqing 400065,China)

机构地区：[1]重庆邮电大学计算机科学与技术学院,重庆400065 [2]重庆邮电大学重庆市图像认知重点实验室,重庆400065

出　　处：《太赫兹科学与电子信息学报》2023年第7期939-951,共13页Journal of Terahertz Science and Electronic Information Technology

基　　金：国家自然科学基金资助项目(61972060;62027827,U1713213,61902046);国家重点研发计划资助项目(2019YFE0110800);重庆市自然科学基金资助项目(cstc2020jcyj-zdxmX0025,cstc2019cxcyljrc-td0270);重庆市留学人员回国创业创新支持计划资助项目(cx2018120);重庆市高新技术研究计划资助项目(cstc2018jcyjAX0279)。

摘　　要：在许多地球科学应用中要用到大量的高时空分辨力的地球观测数据。时空图像融合方法为产生高时空分辨力的数据提供了一种可行且经济的解决方案。然而,现有的一些基于学习的方法对于图像深层特征提取能力较弱,对于高分辨力图像细节特征利用度不够。针对这些问题,提出一种基于多级特征补偿的遥感图像时空融合方法。该方法使用2个分支进行多层级的特征补偿,并提出了融合通道注意力机制的残差模块作为网络的基本组成单元,可以将高分辨力输入图像的深层特征更为详尽地提取利用。提出一种基于拉普拉斯算子的边缘损失,在节省预训练计算开销的同时取得了很好的融合效果。使用从山东和广东2个地区采集的Landsat和中分辨力成像光谱仪(MODIS)卫星图像对所提出的方法进行实验评估。实验结果表明,提出的方法在视觉外观和客观指标方面都具有更高质量。A large amount of earth observation data with the high spatial and temporal resolution is employed in many earth science applications.The spatiotemporal image fusion method provides a feasible and economical solution for generating high spatiotemporal resolution data.However,some of the existing learning-based methods are poor in extracting deep image features and utilizing the detail features of high-resolution image.A spatiotemporal fusion method is proposed for remote sensing images based on multi-level feature compensation.It uses two branches to perform multi-level feature compensation and proposes a residual module fused with a channel attention mechanism as the basic unit of the network,which can extract and utilize the deep features of high-resolution input images in more detail.An edge loss is proposed based on the Laplacian operator,which saves the computational cost of pre-training and achieves a good fusion effect.The proposed method is experimentally evaluated by using Landsat and Moderate-resolution Imaging Spectroradiometer(MODIS)satellite images collected from two regions in Shandong and Guangdong.Experimental results show that the proposed method bears higher quality in both visual appearance and objective metrics.

关 键 词：时空融合 注意力机制 边缘损失 特征补偿 

分 类 号：TP751[自动化与计算机技术—检测技术与自动化装置]