多视图立体三维重建中的孔洞修复算法  

Hole-Filling Algorithm in Multi-view Stereo Reconstruction

作　　者：吴晓军[1,2] 文飞[1] 温佩芝[3] 

机构地区：[1]哈尔滨工业大学深圳研究生院,深圳518055 [2]深圳先进运动控制技术与现代自动化装备重点实验室,深圳518055 [3]桂林电子科技大学计算机科学与工程学院,桂林541004

出　　处：《计算机辅助设计与图形学学报》2012年第12期1606-1613,共8页Journal of Computer-Aided Design & Computer Graphics

基　　金：国家自然科学基金(61063019);深圳市科技计划项目(JC201005260161A;JC21104210015A;CXB201105100073A);深圳南山科技计划项目(201002)

摘　　要：为了解决多视图立体三维重建算法不能很好地处理弱纹理或无纹理及高光区域的重建问题,提出一种基于可见外壳与多视图三维点云有机融合的多视图立体三维重建孔洞修复算法.该算法以可见外壳及多视图三维点云为输入,首先提取出可见外壳内满足点云稀疏度约束的叶节点,然后利用可见外壳法向量射线约束去除包裹在三维点云外层的叶节点,最后通过加入三维点云曲面曲率约束来消除点云中凹陷区域的影响.实验结果表明,文中算法有效地解决了物体缺乏纹理区域表面的孔洞修复问题,使得最终生成的三维网格模型完整和平滑,具有参数可调、易于实现的特点,对于不同的模型都具有非常好的鲁棒性.To solve the surface reconstruction problem in weak texture or textureless and specular area in multi-view stereo （MVS）, a novel hole-filling method is presented for MVS surface reconstruction based on visual hull and depth map fusion. The visual hull and 3D point cloud are taken as input data for fusion. Firstly we extract the voxels that are satisfied the sparsity constraint of 3D point cloud from visual hull, and then in order to get rid of the outer leaf nodes, the constraint of visual hull surface normal and rays is employed. Finally, mean curvature of the surface model is used to eliminate the influence to concave area. The proposed approach has been implemented and the performance of the approach is demonstrated on several real datasets. The results show that it is an effective way to restore the textureless and occluded surfaces of the obiect. And our algorithm is simple to implement, parameters tunable and robust for different models.

关 键 词：孔洞修复 多视图立体三维重建 可见外壳 点云稀疏度 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]