PAPS: Progressive Attention-Based Pan-sharpening  

作　　者：Yanan Jia Qiming Hu Renwei Dian Jiayi Ma Xiaojie Guo 

机构地区：[1]College of Intelligence and Computing,Tianjin University,Tianjin 300350 China [2]IEEE [3]School of Robotics,Hunan University,Changsha 410082,China [4]Electronic Information School,Wuhan University,Wuhan 430072,China

出　　处：《IEEE/CAA Journal of Automatica Sinica》2024年第2期391-404,共14页自动化学报（英文版）

基　　金：partially supported by the National Natural Science Foundation of China (62372251)。

摘　　要：Pan-sharpening aims to seek high-resolution multispectral(HRMS) images from paired multispectral images of low resolution(LRMS) and panchromatic(PAN) images, the key to which is how to maximally integrate spatial and spectral information from PAN and LRMS images. Following the principle of gradual advance, this paper designs a novel network that contains two main logical functions, i.e., detail enhancement and progressive fusion, to solve the problem. More specifically, the detail enhancement module attempts to produce enhanced MS results with the same spatial sizes as corresponding PAN images, which are of higher quality than directly up-sampling LRMS images.Having a better MS base(enhanced MS) and its PAN, we progressively extract information from the PAN and enhanced MS images, expecting to capture pivotal and complementary information of the two modalities for the purpose of constructing the desired HRMS. Extensive experiments together with ablation studies on widely-used datasets are provided to verify the efficacy of our design, and demonstrate its superiority over other state-of-the-art methods both quantitatively and qualitatively. Our code has been released at https://github.com/JiaYN1/PAPS.

关 键 词：High-resolution multispectral image image fusion pan-sharpening progressive enhancement 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]