基于多尺度注意力网络的立体匹配方法  

Stereo Matching Method Based on Multiscale Attention Network

作　　者：边继龙[1] 王厚博 李金凤 BIAN Ji-long;WANG Hou-bo;LI Jin-feng(College of Information&Computer Engineering,Northeast Forestry University,Harbin 150040,China;College of Computer&Information Technology,Mudanjiang Normal University,Mudanjiang 157011,China)

机构地区：[1]东北林业大学信息与计算机工程学院,哈尔滨150040 [2]牡丹江师范学院计算机与信息技术学院,牡丹江157011

出　　处：《北京邮电大学学报》2021年第3期27-34,共8页Journal of Beijing University of Posts and Telecommunications

基　　金：黑龙江省自然科学基金项目(F2018002);黑龙江省基本科研业务费项目(1451MSYYB001);中央高校基本科研业务费专项项目(2572016BB12)。

摘　　要：为解决网络深度与训练图像块大小耦合问题及进一步提高弱纹理区域及边缘处的匹配精度,提出了一种基于多尺度注意力网络的立体匹配方法.该方法将立体匹配过程分为2个阶段:第1阶段提出了一种成本网络用于计算匹配成本,该网络由基础网络层和缩放层组成.第2阶段提出了一种基于多尺度注意力的视差求精网络,该视差求精网络综合了多种视差线索,并加入多尺度注意力机制进一步提高立体匹配精度.该方法在KITTI 2012、KITTI 2015和SceneFlow数据集上的3像素坏点百分比分别为1.13%,1.87%和2.29%.实验结果表明,与国内外同类方法相比,采用多尺度注意力网络的立体匹配方法在匹配精度上获得了较大的提升,尤其是在弱纹理区域及物体边缘处表现较好.Aiming at the problem that the depth of network is related to the size of training image patches and improving the matching accuracy for the weak texture and edge regions,a multiscale attention network for stereo matching is presented.The method is divided into two stages:in the first stage,a deep network for computing matching cost is proposed,which is composed of basic layer and scale layer,in the second stage,a disparity refinement network based on multiscale attention is proposed,in which multiple disparity clues are combined and multiscale attention is added to boost stereo matching accuracy.The percentage of 3-pixel bad points on KITTI 2012,KITTI 2015,and SceneFlow is 1.13%,1.87%,and 2.29%,respectively.Experiments show that compared with the current domestic and foreign advanced methods,a stereo matching method based on multiscale attention network made a great improvement in matching accuracy,especially better improvement for the weak texture and edge regions.

关 键 词：深度网络 立体匹配 匹配成本 多尺度注意力 视差求精 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]