Joint view synthesis and disparity refinement for stereo matching  

作　　者：Gaochang WU Yipeng LI Yuanhao HUANG Yebin LIU 

机构地区：[1]State Key Laboratory of Synthetical Automation for Process Industries,Northeastern University,Shenyang 110819,China [2]Broadband Network&Digital Media Lab,Department of Automation,Tsinghua University,Beijing 100084,China [3]Orbbec Company,Shenzhen 518061,China

出　　处：《Frontiers of Computer Science》2019年第6期1337-1352,共16页中国计算机科学前沿（英文版）

基　　金：supported by the National key foundation for exploring scientific instrument(2013YQ140517);the National Natural Science Foundation of China(Grant No.61522111);the Shenzhen Peacock Plan(KQTD20140630115140843).

摘　　要：Typical stereo algorithms treat disparity estimation and view synthesis as two sequential procedures.In this paper,we consider stereo matching and view synthesis as two complementary components,and present a novel iterative refinement model for joint view synthesis and disparity refinement.To achieve the mutual promotion between view synthesis and disparity refinement,we apply two key strategies,disparity maps fusion and disparity-assisted plane sweep-based rendering(DAPSR).On the one hand,the disparity maps fusion strategy is applied to generate disparity map from synthesized view and input views.This strategy is able to detect and counteract disparity errors caused by potential artifacts from synthesized view.On the other hand,the DAPSR is used for view synthesis and updating,and is able to weaken the interpolation errors caused by outliers in the disparity maps.Experiments on Middlebury benchmarks demonstrate that by introducing the synthesized view,disparity errors due to large occluded region and large baseline are eliminated effectively and the synthesis quality is greatly improved.

关 键 词：stereo matching view synthesis disparity refinement 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]