Energy-based multi-view piecewise planar stereo  

作　　者：Wei WANG Lihua HU Zhanyi HU 

机构地区：[1]School of Network Engineering, Zhoukou Normal University [2]National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences [3]School of Computer Science and Technology, Taiyuan University of Science and Technology

出　　处：《Science China(Information Sciences)》2017年第3期28-45,共18页中国科学（信息科学）（英文版）

基　　金：supported by National Natural Science Foundation of China(Grant Nos.61421004,61333015,61273280,61103143,U1404620,U1404622);Development Project of Henan Provincial Department of Science and Technology(Grant No.152102310381);Scientific Research Starting Foundation for Advanced Talents of Zhoukou Normal University(Grant No.zknuc2015103)

摘　　要：The piecewise planar model （PPM） is an effective means of approximating a complex scene by using planar patches to give a complete interpretation of the spatial points reconstructed from projected 2D images. The traditional pieeewise planar stereo methods suffer from either a very restricted number of directions for plane detection or heavy reliance on the segmentation accuracy of superpixels. To address these issues, we propose a new multi-view piecewise planar stereo method in this paper. Our method formulates the problem of complete scene reconstruction as a multi-level energy minimization problem. To detect planes along principal directions, a novel energy formulation with pair-wise potentials is used to assign an optimal plane for each superpixel in an iterative manner, where reliable scene priors and geometric constraints are incorporated to enhance the modeling efficacy and inference efficiency. To detect non-principal-direction planes, we adopt a multi-direction plane sweeping with a restricted search space method to generate reliable candidate planes. To handle the multi-surface straddling problem of a single superpixel, a superpixel sub-segmenting scheme is proposed and a robust P~ Potts model-like higher-order potential is introduced to refine the resulting depth map. Our method is a natural integration of pixel- and superpixeMevel multi-view stereos under a unified energy minimization framework. Experimental results for standard data sets and our own data sets show that our proposed method can satisfactorily handle many challenging factors （e.g., slanted surfaces and poorly textured regions） and can obtain accurate piecewise planar depth maps.The piecewise planar model （PPM） is an effective means of approximating a complex scene by using planar patches to give a complete interpretation of the spatial points reconstructed from projected 2D images. The traditional pieeewise planar stereo methods suffer from either a very restricted number of directions for plane detection or heavy reliance on the segmentation accuracy of superpixels. To address these issues, we propose a new multi-view piecewise planar stereo method in this paper. Our method formulates the problem of complete scene reconstruction as a multi-level energy minimization problem. To detect planes along principal directions, a novel energy formulation with pair-wise potentials is used to assign an optimal plane for each superpixel in an iterative manner, where reliable scene priors and geometric constraints are incorporated to enhance the modeling efficacy and inference efficiency. To detect non-principal-direction planes, we adopt a multi-direction plane sweeping with a restricted search space method to generate reliable candidate planes. To handle the multi-surface straddling problem of a single superpixel, a superpixel sub-segmenting scheme is proposed and a robust P~ Potts model-like higher-order potential is introduced to refine the resulting depth map. Our method is a natural integration of pixel- and superpixeMevel multi-view stereos under a unified energy minimization framework. Experimental results for standard data sets and our own data sets show that our proposed method can satisfactorily handle many challenging factors （e.g., slanted surfaces and poorly textured regions） and can obtain accurate piecewise planar depth maps.

关 键 词：pieeewise planar model depth map plane fitting energy optimization multi-view stereo 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]