基于双特征融合引导的深度图像超分辨率重建网络  

Depth Image Super-Resolution Reconstruction Network Based on Dual Feature Fusion Guidance

作　　者：耿浩文 王宇[1] 辛彦玲 Geng Haowen;Wang Yu;Xin Yanling(College of Information Science and Engineering,Changchun University of Science and Technology,Changchun 130012,Jilin,China)

机构地区：[1]长春理工大学电子信息工程学院,吉林长春130012

出　　处：《激光与光电子学进展》2024年第8期391-398,共8页Laser & Optoelectronics Progress

基　　金：吉林省自然科学基金(20210101180JC)。

摘　　要：针对彩色图像引导的深度图像超分辨率重建算法中存在的纹理转移和深度流失的问题,提出一种基于双特征融合引导的深度图像超分辨率重建网络(DF-Net)。为了充分利用深度和强度特征的关联性,在网络模型的深度恢复重建部分采用双通道融合模块(DCM)和双特征引导重建模块(DGM)。利用输入金字塔结构提取深度信息和强度信息的多尺度特征:DCM基于通道注意力机制对深度特征和强度特征进行通道间的特征融合与增强;DGM将深度、强度特征自适应选择融合后实现重建的双特征引导,增加了深度特征的引导作用,改善了纹理转移和深度流失的问题。实验结果表明,所提方法的峰值信噪比(PSNR)和均方根误差(RMSE)优于RMRF、JBU和Depth-Net等方法,尤其4×超分辨率重建结果的PSNR值比其他方法平均提升6.79 dB,RMSE平均下降0.94,取得了较好的深度图像超分辨率重建效果。A depth image superresolution reconstruction network(DFNet)based on dual feature fusion guidance is proposed to address the issues of texture transfer and depth loss in color image guided deep image superresolution reconstruction algorithms.To fully utilize the correlation between depth and intensity features,a dual channel fusion module(DCM)and a dual feature guided reconstruction module(DGM)are used to perform deep recovery and reconstruction in the network model.The multiscale features of depth and intensity information are extracted using a input pyramid structure:DCM performs feature fusion and enhancement between channels based on a channel attention mechanism for depth and intensity features;DGM provides dual feature guidance for reconstruction by adaptively selecting and fusing depth and intensity features,increasing the guidance effect of depth features,and overcoming the issues of texture transfer and depth loss.The experimental results show that the peak signaltonoise ratio(PSNR)and root mean square error(RMSE)of the proposed method are superior to those of methods such as RMRF,JBU,and Depth Net.Compared to the other methods,the PSNR value of the 4×superresolution reconstruction results increased by an average of 6.79 dB,and the RMSE decreased by an average of 0.94,thus achieving good depth image superresolution reconstruction results.

关 键 词：图像处理 图像超分辨率重建 卷积神经网络 深度图像 特征融合 通道注意力 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]