多路并行多尺度特征复用的遥感图像超分辨率  

Multi-Path Parallel Multi-Scale Feature Reuse for Remote Sensing Image Super-Resolution

作　　者：赵旭 胡德敏[1] ZHAO Xu;HU Demin(School of Optical-Electrical and Computer Engineering,University of Shanghai for Science and Technology,Shanghai 200093,China)

机构地区：[1]上海理工大学光电信息与计算机工程学院,上海200093

出　　处：《电子科技》2024年第6期61-68,共8页Electronic Science and Technology

基　　金：国家自然科学基金(61170277,61472256);上海市教委科研创新重点项目(12zz137);上海市一流学科建设项目(S1201YLXK)。

摘　　要：遥感图像内部物体尺寸小、分布不均匀、耦合程度高,针对目前遥感图像超分辨率模型特征提取信息单一且利用不足的现状,文中提出一种多路并行多尺度特征复用网络模型以改进图像重建的性能。该模型使用局部特征级联和全局特征融合的结构融合多个网络残差块提取的特征信息,其中每个残差块由两个多尺度卷积单元串行连接。多尺度卷积单元通过对特征信息进行交叉融合,构建多路并行的分支提取图像特征。同时引入短跳跃连接加强不同分支之间的特征复用,通过长跳跃连接加强网络不同深度的特征融合。当放大因子为4时,在两个测试集上该模型的峰值信噪比分别为29.6531 dB、29.0374 dB,相对于其他模型的测试结果具有明显提升,因此所提模型在遥感图像超分辨率重建上具有较好的效果。Objects in remote sensing images are small in size,unevenly distributed,and highly coupled.In view of the current situation that the feature extraction information of remote sensing image super-resolution models is single and underutilized,this study proposes a multi-path parallel multi-scale feature reuse network model to improve performance of image reconstruction.The model fuses feature information extracted from multiple network residual blocks using a structure of local feature cascade and global feature fusion,where each residual block is serially connected by two multi-scale convolutional units.The multi-scale convolution units construct multiple branches to extract image features in parallel through cross-fusion of feature information.At the same time,short skip connections are introduced to strengthen feature reuse between different branches,and long skip connections are introduced to strengthen feature fusion at different depths of the network.When the amplification factor is 4,the peak signal-to-noise ratios of the model on the two test sets are 29.6531 dB and 29.0374 dB respectively,and they are significantly improved compared with the test results of other models.Therefore,the proposed model has a good effect on super-resolution reconstruction of remote sensing images.

关 键 词：遥感图像 超分辨率 多路径 并行提取 多尺度 特征复用 跳跃连接 卷积神经网络 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]