Three-dimensional face point cloud hole-filling algorithm based on binocular stereo matching and a B-spline  

作　　者：Yuan HUANG Feipeng DA 

机构地区：[1]School of Automation,Southeast University,Xznjing 210096,China [2]Shenzhen Research Institute of Southeast University,Shenzhen 518000,China

出　　处：《Frontiers of Information Technology & Electronic Engineering》2022年第3期398-408,共11页信息与电子工程前沿（英文版）

基　　金：supported by the National Natural Science Foundation of China(No.61405034);the Special Project on Basic Research of Frontier Leading Technology of Jiangsu Province,China(No.BK20192004C);the Shenzhen Science and Technology Innovation Committee(No.JCYJ20180306174455080);the Natural Science Foundation of Jiangsu Province,China(No.BK20181269)。

摘　　要：When obtaining three-dimensional(3D)face point cloud data based on structured light,factors related to the environment,occlusion,and illumination intensity lead to holes in the collected data,which affect subsequent recognition.In this study,we propose a hole-filling method based on stereo-matching technology combined with a B-spline.The algorithm uses phase information acquired during raster projection to locate holes in the point cloud,simultaneously extracting boundary point cloud sets.By registering the face point cloud data using the stereo-matching algorithm and the data collected using the raster projection method,some supplementary information points can be obtained at the holes.The shape of the B-spline curve can then be roughly described by a few key points,and the control points are put into the hole area as key points for iterative calculation of surface reconstruction.Simulations using smooth ceramic cups and human face models showed that our model can accurately reproduce details and accurately restore complex shapes on the test surfaces.Simulation results indicated the robustness of the method,which is able to fill holes on complex areas such as the inner side of the nose without a prior model.This approach also effectively supplements the hole information,and the patched point cloud is closer to the original data.This method could be used across a wide range of applications requiring accurate facial recognition.

关 键 词：Three-dimensional(3D)point cloud Hole filling Stereo matching B-SPLINE 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]