基于深监督跨尺度注意力网络的深度图像超分辨率重建  

Depth Map Super-Resolution Reconstruction Based on Deeply Supervised Cross-Scale Attention Network

作　　者：李滔 董秀成 林宏伟[2] LI Tao;DONG Xiu-cheng;LIN Hong-wei(School of Electrical Engineering and Electronic Information,Xihua University,Chengdu,Sichuan 610039,China;College of Electrical Engineering,Northwest Minzu University,Lanzhou,Gansu 730000,China)

机构地区：[1]西华大学电气与电子信息学院,四川成都610039 [2]西北民族大学电气工程学院,甘肃兰州730000

出　　处：《电子学报》2023年第1期128-138,共11页Acta Electronica Sinica

基　　金：国家自然科学基金(No.61901392,No.62041109);四川省科技计划(No.2021YJ0109,No.2021ZYD0034)。

摘　　要：消费级深度相机拍摄的深度图像具有分辨率较低的问题,深度图像超分辨率重建是解决该问题的有效方法 .为了提高重建性能,提出一种基于深监督跨尺度注意力网络的深度图像超分辨率重建算法.网络逐级放大,在损失函数中对每一级的输出都进行约束,实现深监督的目的 .采用高阶跨尺度注意力模块,将多尺度特征尺度内及跨尺度相关性与注意力机制结合起来,实现多尺度特征的自适应调整.采用内层为宽激活残差、外层为基本残差的双层残差块作为网络基本构成元素,以提高网络对复杂非线性关系的学习能力.实验结果表明,本文算法在主观视觉效果和客观质量评价指标方面都优于当前主流的深度图像超分辨率重建算法.Depth maps captured by consumer depth cameras usually suffer from low spatial resolution. Depth map super-resolution(SR) is an effective method to solve this problem. To improve the reconstruction performance, this paper proposes a depth map super-resolution reconstruction algorithm based on deeply supervised cross-scale attention network. A multi-stage up-sampling strategy is introduced. The loss function of the network contains the constraint on the output of each stage for a deep supervision. A high-order cross-scale attention block is proposed to adaptively adjust multi-scale features by integrating the in-scale and cross-scale correlations of multi-scale features with the attention mechanism. A bilayer residual block, which contains inner wide-activated residual learning and outer basic residual learning, is used as the basic component of network for more powerful ability of complex non-linear relationship learning. Experimental results demonstrate the superiority of the proposed algorithm over several state-of-the-art depth map SR methods in terms of visual comparison and quantitative evaluation.

关 键 词：深度图像超分辨率 深度学习 深监督 多尺度特征表示 残差块 

分 类 号：TP751.1[自动化与计算机技术—检测技术与自动化装置] TP183[自动化与计算机技术—控制科学与工程]